-- Logs begin at Tue 2022-08-02 08:29:00 UTC, end at Tue 2022-08-02 09:30:51 UTC. -- Aug 02 09:01:55.845226 dv-cinder-803823-15-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 09:01:55.854936 dv-cinder-803823-15-smb devstack@keystone.service[80509]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 09:01:55 2022] *** Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: nodename: dv-cinder-803823-15-smb Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: machine: x86_64 Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: clock source: unix Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: pcre jit disabled Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: detected number of CPU cores: 4 Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: current working directory: / Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: detected binary path: /usr/bin/uwsgi-core Aug 02 09:01:55.856167 dv-cinder-803823-15-smb devstack@keystone.service[80509]: your processes number limit is 47680 Aug 02 09:01:55.856796 dv-cinder-803823-15-smb devstack@keystone.service[80509]: your memory page size is 4096 bytes Aug 02 09:01:55.856796 dv-cinder-803823-15-smb devstack@keystone.service[80509]: detected max file descriptor number: 2048 Aug 02 09:01:55.856796 dv-cinder-803823-15-smb devstack@keystone.service[80509]: lock engine: pthread robust mutexes Aug 02 09:01:55.856796 dv-cinder-803823-15-smb devstack@keystone.service[80509]: thunder lock: enabled Aug 02 09:01:55.856796 dv-cinder-803823-15-smb devstack@keystone.service[80509]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 09:01:55.856796 dv-cinder-803823-15-smb devstack@keystone.service[80509]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 09:01:55.896556 dv-cinder-803823-15-smb devstack@keystone.service[80509]: Python main interpreter initialized at 0x55a92aed39c0 Aug 02 09:01:55.896556 dv-cinder-803823-15-smb devstack@keystone.service[80509]: python threads support enabled Aug 02 09:01:55.896556 dv-cinder-803823-15-smb devstack@keystone.service[80509]: your server socket listen backlog is limited to 100 connections Aug 02 09:01:55.896556 dv-cinder-803823-15-smb devstack@keystone.service[80509]: your mercy for graceful operations on workers is 90 seconds Aug 02 09:01:55.896882 dv-cinder-803823-15-smb devstack@keystone.service[80509]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 09:01:55.896992 dv-cinder-803823-15-smb devstack@keystone.service[80509]: *** Operational MODE: preforking *** Aug 02 09:01:55.897269 dv-cinder-803823-15-smb devstack@keystone.service[80509]: *** uWSGI is running in multiple interpreter mode *** Aug 02 09:01:55.897269 dv-cinder-803823-15-smb devstack@keystone.service[80509]: spawned uWSGI master process (pid: 80509) Aug 02 09:01:55.897482 dv-cinder-803823-15-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 02 09:01:55.901739 dv-cinder-803823-15-smb devstack@keystone.service[80509]: spawned uWSGI worker 1 (pid: 80520, cores: 1) Aug 02 09:01:55.901739 dv-cinder-803823-15-smb devstack@keystone.service[80509]: spawned uWSGI worker 2 (pid: 80521, cores: 1) Aug 02 09:01:55.901739 dv-cinder-803823-15-smb devstack@keystone.service[80509]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 09:02:01.459572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:01.459572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: from cryptography.utils import int_from_bytes Aug 02 09:02:01.460403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:01.460403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: from cryptography.utils import int_from_bytes Aug 02 09:02:01.460821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:01.460821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: from cryptography.utils import int_from_bytes Aug 02 09:02:01.460934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:01.460934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: from cryptography.utils import int_from_bytes Aug 02 09:02:01.510691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:02:01.510856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:02:01.510856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:02:01.511011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:02:01.511082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] command line args: [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:02:01.511142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] command line args: [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:02:01.511327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:02:01.511423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:02:01.511509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ================================================================================ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:02:01.511583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ================================================================================ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:02:01.511760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] admin_token = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.511847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] admin_token = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config_dir = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config_dir = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config_source = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] config_source = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] debug = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] debug = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.512783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513343 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513688 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.513974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_config_append = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_config_append = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_dir = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_dir = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.514934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.515890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.516866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.517862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.518019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.518097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.518300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.518388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.518802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.518881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.518988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] publish_errors = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] publish_errors = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.519981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] standard_threads = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] standard_threads = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.520934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_journal = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_journal = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_json = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_json = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_stderr = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_stderr = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_syslog = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] use_syslog = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.521965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.522124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:01.522246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.522322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.522441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.522517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.522708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.522799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.522952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.523953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.524952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.525977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.526113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.526249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.526322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.526501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.526577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.526761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.526839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.527851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.528999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.529083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.529237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.529315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.529491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.529569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.529760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.529853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.530981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.531946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.532984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533200 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.533984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.534943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.535900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.536869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.537895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.538837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.539999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.540970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.541088 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.541209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.541303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.541458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.541537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.542261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.542411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.542512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.542583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.542760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.542850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.542997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.543997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544077 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.544961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.545932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546730 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.546975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.547989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.548156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.548239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.548392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.external = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.548477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.external = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.548626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.548707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.548929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.password = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.password = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.token = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] auth.token = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.549989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550720 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.550975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.551956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.552940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.553991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.554159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.554245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.554447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.554526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.554698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.554856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.554970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555050 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.555971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.556971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.557063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.557216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.557379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.558868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.559894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.560859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.561877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562772 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.562862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.563889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.564847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.565835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.566981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.567963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.568926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.569944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.570923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.571957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.572985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.573153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.573274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.573403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.573519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.573644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.573789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.573907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.574851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.575904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.576961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.577941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.578940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.579905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.580875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.581888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.582876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.583841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.584834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.585884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.586056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.586134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.586292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.586370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.594950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.595995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.596955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.597989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.598942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599580 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.599940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600598 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.600979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.601849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.602998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:02:01.603722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:01.603722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:02:01.631512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.631739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.631958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.632054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.632196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.632421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.640364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.641145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.670759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.670982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.671887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.672128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.723755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.724500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.775516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.775681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.775754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.775914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.843418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.843654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.843774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.843870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.843990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.844077 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.844218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.844314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.844489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.844602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.844722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.844890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.868117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.868331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.868421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.868567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.868670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.868793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.868874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.869014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.869093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.869233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.869322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.869447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.869528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.869663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.887386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.887597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.900083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.900318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.900545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.900628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.900774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.900858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.901023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.901240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.901369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.901491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.901563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.901626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.901743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.902008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:02:01.918211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.918426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:02:01.918558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.918729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:02:01.918857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.918996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:02:01.919131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.919258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.919407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:02:01.919541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.919666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.919791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.919924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.920049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.920174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.920333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.929591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.929893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.930108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.930236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.930390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.930516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.930666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.931020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.937983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.938868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.942708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.942989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.943272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.943551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.943677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.943834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.943962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.944101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.944238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.944368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.944497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.944625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.944765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.944902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.945033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.945162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.945290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.945419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.945556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.945726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.946015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.946285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.968971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.970494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.970777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.971164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.972660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.972945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.975689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.975926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.976209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.977868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.978160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.978446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.983033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.983317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.985426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.985739 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.987633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.987922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.988204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.988485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.988758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.989061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.989330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.989610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.989955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:01.990248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.990535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.990819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.991095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.991395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.991668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:01.991949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.006075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.006364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.008582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.008861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.010285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.013545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.014012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.014308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.016711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.017010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.018670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.021423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.021844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.024634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.024979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.025277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.025567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.025899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.026208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.026491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.027929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.028232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.028535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.028831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.029120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.029411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.042691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.042966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.043231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.043494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.045460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.045768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.046037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.046299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.050393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.051943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.052219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.053202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.054793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.055047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.055178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.055332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.055629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.055916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.056194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.058621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.058900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.059201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.059484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.059773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.068231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.068510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.068788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.069068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.069347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.069620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.069920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.071259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.071545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.071830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.072119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.072404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.072679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.073498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.086315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.089122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.089303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.092125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.092443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.094923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.095115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.096488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.096778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.097057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.097612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.099402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.099700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.100007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.103770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.105598 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.106600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.108220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.108526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.108816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.109098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.109382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.111197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.111491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.111779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.112058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.117519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.117832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.118130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.120663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.120948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.121241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.125786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.128124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:02:02.128255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.128399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.128771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.128902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.129055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.129181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.129333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.129468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.129629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.129804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.129932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.130060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.130199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.130329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.130566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.130695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.130866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.131993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.132121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:02:02.165928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a92aed39c0 pid: 80520 (default app) Aug 02 09:02:02.166304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a92aed39c0 pid: 80521 (default app) Aug 02 09:02:02.169852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9bb4-ff42-4b3b-971c-cd8c06b47d6b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:02.170146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9bb4-ff42-4b3b-971c-cd8c06b47d6b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:02.170426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9bb4-ff42-4b3b-971c-cd8c06b47d6b None None] PATH_INFO: `/v3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:02.174759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Tue Aug 2 09:02:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:10.786676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026d99-6c5a-4fe9-a657-983a4e36259f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.787252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026d99-6c5a-4fe9-a657-983a4e36259f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.787252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026d99-6c5a-4fe9-a657-983a4e36259f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.792152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:10.797420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:10.797844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:10.798016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:10.871751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: INFO dbcounter [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] Registered counter for database keystone Aug 02 09:02:10.892189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG oslo_db.sqlalchemy.engines [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:10.898476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writer thread running {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:11.082672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG passlib.handlers.bcrypt [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80520) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 09:02:11.083005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG passlib.handlers.bcrypt [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80520) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 09:02:11.138827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:11.140435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:11.272187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 09:02:11.381084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db026d99-6c5a-4fe9-a657-983a4e36259f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:11.450978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: INFO dbcounter [None req-db026d99-6c5a-4fe9-a657-983a4e36259f None None] Registered counter for database keystone Aug 02 09:02:11.472422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG oslo_db.sqlalchemy.engines [None req-db026d99-6c5a-4fe9-a657-983a4e36259f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80521) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:11.478918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writer thread running {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:11.598283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db026d99-6c5a-4fe9-a657-983a4e36259f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:11.603069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9420a4-6bea-4bc5-b8a3-83d2ea532ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:11.603718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9420a4-6bea-4bc5-b8a3-83d2ea532ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.604145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9420a4-6bea-4bc5-b8a3-83d2ea532ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.604433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9420a4-6bea-4bc5-b8a3-83d2ea532ea5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.612540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9420a4-6bea-4bc5-b8a3-83d2ea532ea5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:11.664519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4a9420a4-6bea-4bc5-b8a3-83d2ea532ea5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 09:02:11.664812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9420a4-6bea-4bc5-b8a3-83d2ea532ea5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:11.674832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Tue Aug 2 09:02:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:02:11.680786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:11.695758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671bf1b-6276-4f9a-9c5a-e1becc65da37 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:11.700820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9d530-cf9b-4938-8a9d-878b054b6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:11.701975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d530-cf9b-4938-8a9d-878b054b6f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:11.702266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d530-cf9b-4938-8a9d-878b054b6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:11.702545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d530-cf9b-4938-8a9d-878b054b6f0a admin admin] PATH_INFO: `/v3/projects/111a65792e6b4d558825e4b022d50a1d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:11.704047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9d530-cf9b-4938-8a9d-878b054b6f0a admin admin] RBAC: Authorizing `identity:get_project(project_id=111a65792e6b4d558825e4b022d50a1d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:11.754603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d4f9d530-cf9b-4938-8a9d-878b054b6f0a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 09:02:11.754950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9d530-cf9b-4938-8a9d-878b054b6f0a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:11.759608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Tue Aug 2 09:02:11 2022] GET /identity/v3/projects/111a65792e6b4d558825e4b022d50a1d => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:13.748461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78b949-13ca-4305-9c97-422b77f5b7bc None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.749013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78b949-13ca-4305-9c97-422b77f5b7bc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.749013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78b949-13ca-4305-9c97-422b77f5b7bc None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.753153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:13.758479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237ebd5-363e-4edf-957d-511ffa0f8d4b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.758846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237ebd5-363e-4edf-957d-511ffa0f8d4b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.759048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237ebd5-363e-4edf-957d-511ffa0f8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.780157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2237ebd5-363e-4edf-957d-511ffa0f8d4b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:13.781680 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2237ebd5-363e-4edf-957d-511ffa0f8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:13.789590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 09:02:13.811411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78b949-13ca-4305-9c97-422b77f5b7bc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.823626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78b949-13ca-4305-9c97-422b77f5b7bc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.827822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadca302-262a-4545-8015-f317aae4e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.839619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca302-262a-4545-8015-f317aae4e1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.839619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca302-262a-4545-8015-f317aae4e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.839619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca302-262a-4545-8015-f317aae4e1c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.839619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadca302-262a-4545-8015-f317aae4e1c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.839619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadca302-262a-4545-8015-f317aae4e1c9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.847900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Tue Aug 2 09:02:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:02:13.853559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237ebd5-363e-4edf-957d-511ffa0f8d4b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:13.863586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237ebd5-363e-4edf-957d-511ffa0f8d4b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:13.867982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dea0c4-1478-4bc9-9285-b221f2640786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:13.870811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea0c4-1478-4bc9-9285-b221f2640786 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:13.870811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea0c4-1478-4bc9-9285-b221f2640786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:13.870811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea0c4-1478-4bc9-9285-b221f2640786 admin admin] PATH_INFO: `/v3/users/277adb39cd4b4eaeb8a14cfd02357b07` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:13.871143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dea0c4-1478-4bc9-9285-b221f2640786 admin admin] RBAC: Authorizing `identity:get_user(user_id=277adb39cd4b4eaeb8a14cfd02357b07)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:13.872990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dea0c4-1478-4bc9-9285-b221f2640786 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:13.874581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Tue Aug 2 09:02:13 2022] GET /identity/v3/users/277adb39cd4b4eaeb8a14cfd02357b07 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:15.924969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba68f-3339-42e0-a2c6-7b325ad176ec None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.925509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba68f-3339-42e0-a2c6-7b325ad176ec None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.925509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba68f-3339-42e0-a2c6-7b325ad176ec None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:15.926890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:15.932807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf84f66-c763-4165-af08-4753a707c79d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.932807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf84f66-c763-4165-af08-4753a707c79d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.933568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf84f66-c763-4165-af08-4753a707c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:15.952447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-acf84f66-c763-4165-af08-4753a707c79d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:15.953620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-acf84f66-c763-4165-af08-4753a707c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:15.981874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b253-2a87-4800-bf19-2884ef15c435 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.982164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b253-2a87-4800-bf19-2884ef15c435 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.982441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b253-2a87-4800-bf19-2884ef15c435 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:15.983775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:15.988676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:15.988966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:15.989252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.031978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG passlib.handlers.bcrypt [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80521) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 09:02:16.032411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG passlib.handlers.bcrypt [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80521) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 09:02:16.033847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:16.057398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf84f66-c763-4165-af08-4753a707c79d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.080346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:16.081188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.081974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:16.162594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf84f66-c763-4165-af08-4753a707c79d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.183305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:16.196158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.196809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.197095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.197374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.205402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.209649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:16.218448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:16.219461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:16.220259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:16.225527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.306453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.308341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16d0e-aab2-4399-855a-5986f05154eb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.310792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.325831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffe6e-ff3c-4988-a166-04b14bf214a4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.346637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.347508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.347799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.348080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.360329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.360957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.361316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.361597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.362412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:16.362725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.364125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.377060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:16.382620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.417400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.418945 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.482535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22055b98-339f-49af-94f4-e1f683bf77c6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.515991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 8/16] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:16.518153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.518796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.519089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.519371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] PATH_INFO: `/v3/users/277adb39cd4b4eaeb8a14cfd02357b07` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.520561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] RBAC: Authorizing `identity:get_user(user_id=277adb39cd4b4eaeb8a14cfd02357b07)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.521557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.522054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.523636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 9/17] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/users/277adb39cd4b4eaeb8a14cfd02357b07 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:16.524381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.528849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.543791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.627585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69586b-20bd-4c6b-b515-f57b2024812c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.665767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.667192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.667588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.667920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.688014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.689559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:02:16.707653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:16.708469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:16.709275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:02:16.709275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:02:16.709275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:02:16.709275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:16.709275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:16.716052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.735978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aa730-22e9-4594-a1ab-0e96136dcab1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.770041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.770683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.770969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.771249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.772399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.773006 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.773947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.775541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:16.782004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:16.821344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5478e0-75d9-4d86-928b-c7449758419e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.856487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c844a1-e067-4554-be27-8f7506ee201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.857113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c844a1-e067-4554-be27-8f7506ee201b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.857403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c844a1-e067-4554-be27-8f7506ee201b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.857683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c844a1-e067-4554-be27-8f7506ee201b None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.858418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c844a1-e067-4554-be27-8f7506ee201b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:16.858821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c844a1-e067-4554-be27-8f7506ee201b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.860226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c844a1-e067-4554-be27-8f7506ee201b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.871170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:16.879306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 10/20] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:16.885077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497b55-eaaa-4d73-8cff-d5a743ec2f80 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:16.922552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dd2e2-1d5e-472b-bed2-92cbebd0f94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:16.923188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd2e2-1d5e-472b-bed2-92cbebd0f94a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:16.923469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd2e2-1d5e-472b-bed2-92cbebd0f94a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:16.923745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd2e2-1d5e-472b-bed2-92cbebd0f94a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:16.924550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dd2e2-1d5e-472b-bed2-92cbebd0f94a None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.domain.id=default, user.id=277adb39cd4b4eaeb8a14cfd02357b07) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:16.924858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dd2e2-1d5e-472b-bed2-92cbebd0f94a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:16.926423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dd2e2-1d5e-472b-bed2-92cbebd0f94a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:16.935091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 11/21] 10.222.0.71 () {56 vars in 1322 bytes} [Tue Aug 2 09:02:16 2022] GET /identity/v3/role_assignments?user.id=277adb39cd4b4eaeb8a14cfd02357b07&scope.domain.id=default&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:19.354677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f8ab-b5d9-41c9-a0ea-2455a85237f8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.355201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f8ab-b5d9-41c9-a0ea-2455a85237f8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.355201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f8ab-b5d9-41c9-a0ea-2455a85237f8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.356511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 11/22] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:19.361775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b954-4caa-4522-90bd-e307a90f8269 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.362181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b954-4caa-4522-90bd-e307a90f8269 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.362337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b954-4caa-4522-90bd-e307a90f8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.386808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-af52b954-4caa-4522-90bd-e307a90f8269 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:19.388033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-af52b954-4caa-4522-90bd-e307a90f8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:19.460297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 12/23] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:19.493904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30f8ab-b5d9-41c9-a0ea-2455a85237f8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:19.616263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30f8ab-b5d9-41c9-a0ea-2455a85237f8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:19.627085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb38a0c-38f3-4813-9aa4-c64964aad5bc None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.627385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb38a0c-38f3-4813-9aa4-c64964aad5bc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.627651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb38a0c-38f3-4813-9aa4-c64964aad5bc None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.629334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:19.634622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa451fd-676d-4ffa-be4a-4890664b6390 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.634988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa451fd-676d-4ffa-be4a-4890664b6390 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.635274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa451fd-676d-4ffa-be4a-4890664b6390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.648702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:19.665753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8aa451fd-676d-4ffa-be4a-4890664b6390 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:19.667732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8aa451fd-676d-4ffa-be4a-4890664b6390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:19.688175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:19.688849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.689443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.689767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.714744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:19.721337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:19.722183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:19.722930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:19.730119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 12/25] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:19.731092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:19.822840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 14/26] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:19.840509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684f4d-94a8-4f02-a144-967981084d06 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.841111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684f4d-94a8-4f02-a144-967981084d06 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.841593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684f4d-94a8-4f02-a144-967981084d06 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.843641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 15/27] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:19.857967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684f4d-94a8-4f02-a144-967981084d06 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:19.872840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:19.921692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312f257-4935-4989-80f9-45077ba2f2a9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:19.966399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b922-2776-4feb-aab1-e5555d4fe227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:19.968295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b922-2776-4feb-aab1-e5555d4fe227 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.969778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b922-2776-4feb-aab1-e5555d4fe227 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.970419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b922-2776-4feb-aab1-e5555d4fe227 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:19.971358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b922-2776-4feb-aab1-e5555d4fe227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:19.973260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b922-2776-4feb-aab1-e5555d4fe227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:19.976564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b922-2776-4feb-aab1-e5555d4fe227 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:19.992806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 13/28] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:19.993757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82815-85fa-43c6-96d1-948e5a65ade6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:19.994062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82815-85fa-43c6-96d1-948e5a65ade6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:19.994993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82815-85fa-43c6-96d1-948e5a65ade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.043448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684f4d-94a8-4f02-a144-967981084d06 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:20.084688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4685da-07ba-4388-a8e5-9ef0fd9ad66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:20.085693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4685da-07ba-4388-a8e5-9ef0fd9ad66a None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.086220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4685da-07ba-4388-a8e5-9ef0fd9ad66a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.086718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4685da-07ba-4388-a8e5-9ef0fd9ad66a None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.087735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4685da-07ba-4388-a8e5-9ef0fd9ad66a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:20.090519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4685da-07ba-4388-a8e5-9ef0fd9ad66a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:20.141376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-40a82815-85fa-43c6-96d1-948e5a65ade6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:20.142536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-40a82815-85fa-43c6-96d1-948e5a65ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:20.176785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:20.217981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 14/29] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:20.219187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63356090-5154-48ca-8242-a31262ad076c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.219481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63356090-5154-48ca-8242-a31262ad076c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.219759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63356090-5154-48ca-8242-a31262ad076c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.221076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 15/30] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:20.221784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63356090-5154-48ca-8242-a31262ad076c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:20.325986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 16/31] 10.222.0.71 () {60 vars in 1131 bytes} [Tue Aug 2 09:02:19 2022] POST /identity/v3/roles => generated 225 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:20.327351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964213c-3c3f-4249-b3c3-85f76bda757e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.334424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964213c-3c3f-4249-b3c3-85f76bda757e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.334605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964213c-3c3f-4249-b3c3-85f76bda757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.351442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63356090-5154-48ca-8242-a31262ad076c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:20.362686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5964213c-3c3f-4249-b3c3-85f76bda757e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:20.364256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5964213c-3c3f-4249-b3c3-85f76bda757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:20.402099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:20.403583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.404412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.404905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] PATH_INFO: `/v3/users/277adb39cd4b4eaeb8a14cfd02357b07` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.407608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] RBAC: Authorizing `identity:get_user(user_id=277adb39cd4b4eaeb8a14cfd02357b07)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:20.411034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:20.417665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 16/32] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:20 2022] GET /identity/v3/users/277adb39cd4b4eaeb8a14cfd02357b07 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:20.419610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:20.485222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:20.496987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 17/33] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:20.498201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964213c-3c3f-4249-b3c3-85f76bda757e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:20.520868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:20.609958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6e8ba-843e-4bee-8183-195257d004e2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:20.640022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964213c-3c3f-4249-b3c3-85f76bda757e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:20.649195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:20.650043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.650430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.651472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.662430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:20.663827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:20.678864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f2591-b3c3-4abd-b8cc-40829b8a9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:20.679517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f2591-b3c3-4abd-b8cc-40829b8a9dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.679798 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f2591-b3c3-4abd-b8cc-40829b8a9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:02:20.679896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:20.680832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:20.681682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:02:20.681682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:02:20.681682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:02:20.681682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:20.682429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f2591-b3c3-4abd-b8cc-40829b8a9dc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.682510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 17/34] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:20.682913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f2591-b3c3-4abd-b8cc-40829b8a9dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:20.682984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:20.683465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f2591-b3c3-4abd-b8cc-40829b8a9dc2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:20.685052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 18/35] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:20.686198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab809-afed-491b-bc72-f1d1009c8f9e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.686481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab809-afed-491b-bc72-f1d1009c8f9e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.686789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab809-afed-491b-bc72-f1d1009c8f9e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.687965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 19/36] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:20.688968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd099-f0a9-40e2-815a-faaf07369b56 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.689253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd099-f0a9-40e2-815a-faaf07369b56 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.689530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd099-f0a9-40e2-815a-faaf07369b56 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.694695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 20/37] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:20.695474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd099-f0a9-40e2-815a-faaf07369b56 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:20.762885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:20.778884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:20.790273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cafa74-a9f9-4290-b3b4-b34c054f8e12 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:20.802227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd099-f0a9-40e2-815a-faaf07369b56 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:20.825320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32acfe8-ff40-42bd-93a4-1f7d82707042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:20.825962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32acfe8-ff40-42bd-93a4-1f7d82707042 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.826246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32acfe8-ff40-42bd-93a4-1f7d82707042 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.826522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32acfe8-ff40-42bd-93a4-1f7d82707042 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.827231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32acfe8-ff40-42bd-93a4-1f7d82707042 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:20.828613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32acfe8-ff40-42bd-93a4-1f7d82707042 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:20.838929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:20.839553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:20.839840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:20.840122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:20.840827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:20.841137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:20.842558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:20.859981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 21/38] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:20.861195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:20.995659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643114-8894-44f1-bcf0-81bdbb19ad62 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:21.030585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:21.047593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534cffe-1489-4895-bfca-f6cc5bae1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:21.048328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534cffe-1489-4895-bfca-f6cc5bae1b5f None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:21.048618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534cffe-1489-4895-bfca-f6cc5bae1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:21.048903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534cffe-1489-4895-bfca-f6cc5bae1b5f None admin] PATH_INFO: `/v3/domains/default/users/277adb39cd4b4eaeb8a14cfd02357b07/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:21.050960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534cffe-1489-4895-bfca-f6cc5bae1b5f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=277adb39cd4b4eaeb8a14cfd02357b07, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:21.052432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534cffe-1489-4895-bfca-f6cc5bae1b5f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:21.079460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 18/39] 10.222.0.71 () {60 vars in 1131 bytes} [Tue Aug 2 09:02:20 2022] POST /identity/v3/roles => generated 219 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:21.080996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e62bc-d48a-4ce0-a924-941659540e06 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:21.081295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e62bc-d48a-4ce0-a924-941659540e06 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:21.081578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e62bc-d48a-4ce0-a924-941659540e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:21.105122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5c4e62bc-d48a-4ce0-a924-941659540e06 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:21.106772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5c4e62bc-d48a-4ce0-a924-941659540e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:21.124956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 22/40] 10.222.0.71 () {58 vars in 1361 bytes} [Tue Aug 2 09:02:20 2022] PUT /identity/v3/domains/default/users/277adb39cd4b4eaeb8a14cfd02357b07/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:21.126696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cf20-7996-46e6-b6ea-6dd088674a0c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:21.126987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cf20-7996-46e6-b6ea-6dd088674a0c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:21.127272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cf20-7996-46e6-b6ea-6dd088674a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:21.156909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d129cf20-7996-46e6-b6ea-6dd088674a0c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:21.158969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d129cf20-7996-46e6-b6ea-6dd088674a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:21.202404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 19/41] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:21.203443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e62bc-d48a-4ce0-a924-941659540e06 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:21.279940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 23/42] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:21.280755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129cf20-7996-46e6-b6ea-6dd088674a0c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:21.309622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:21.343426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e62bc-d48a-4ce0-a924-941659540e06 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:21.384273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:21.384974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:21.386123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:21.387076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:21.388466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:21.390549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:21.415191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129cf20-7996-46e6-b6ea-6dd088674a0c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:21.428857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:21.450803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:21.451447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:21.451738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:21.452022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:21.452750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:21.454245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:21.511690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 20/43] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:02:21 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:21.512526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:21.545850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 24/44] 10.222.0.71 () {60 vars in 1131 bytes} [Tue Aug 2 09:02:21 2022] POST /identity/v3/roles => generated 223 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:21.664399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8d8b1-4246-410b-a368-ee86ef534550 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:21.699489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:21.705919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db3a54-ed9f-4012-af6e-8b88c378ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:21.706603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3a54-ed9f-4012-af6e-8b88c378ae2a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:21.706897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3a54-ed9f-4012-af6e-8b88c378ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:21.707266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3a54-ed9f-4012-af6e-8b88c378ae2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:21.708597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db3a54-ed9f-4012-af6e-8b88c378ae2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:21.710314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db3a54-ed9f-4012-af6e-8b88c378ae2a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:21.712606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 21/45] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:21.718782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:21.840479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d873fa-3845-4e49-8a38-5f3c5eae25a6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:21.874877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1f8b-5266-438d-93d8-d6f0f3665337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:21.875527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1f8b-5266-438d-93d8-d6f0f3665337 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:21.875810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1f8b-5266-438d-93d8-d6f0f3665337 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:21.876086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1f8b-5266-438d-93d8-d6f0f3665337 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:21.876796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1f8b-5266-438d-93d8-d6f0f3665337 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:21.878302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1f8b-5266-438d-93d8-d6f0f3665337 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:21.965877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 25/46] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:02:21 2022] POST /identity/v3/projects => generated 312 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:23.207755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1339f-44b7-4dc9-96e1-ff30571fdf93 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.208297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1339f-44b7-4dc9-96e1-ff30571fdf93 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.208380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1339f-44b7-4dc9-96e1-ff30571fdf93 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.209801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 22/47] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:23.215364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf94873-22de-48c4-ab50-7e2922bf0774 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.215770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf94873-22de-48c4-ab50-7e2922bf0774 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.216075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf94873-22de-48c4-ab50-7e2922bf0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.234810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8cf94873-22de-48c4-ab50-7e2922bf0774 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:23.235988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8cf94873-22de-48c4-ab50-7e2922bf0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:23.253674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.302641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 26/48] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:23.325870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1339f-44b7-4dc9-96e1-ff30571fdf93 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.430121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1339f-44b7-4dc9-96e1-ff30571fdf93 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:23.464320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:23.464887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.465174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.465452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.475552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:23.481248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:23.482357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:23.483305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 23/49] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:23.490046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf94873-22de-48c4-ab50-7e2922bf0774 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.587372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf94873-22de-48c4-ab50-7e2922bf0774 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:23.621818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:23.622449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.622739 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.623019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.623742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:23.624050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:23.625443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:23.633441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 27/50] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:23.639202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.696772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.737765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73f985-493b-4fc5-971a-2ff5e6283110 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:23.770785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:23.771417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.771702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.771984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] PATH_INFO: `/v3/users/277adb39cd4b4eaeb8a14cfd02357b07` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.773149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] RBAC: Authorizing `identity:get_user(user_id=277adb39cd4b4eaeb8a14cfd02357b07)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:23.774640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:23.776936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 24/51] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:23 2022] GET /identity/v3/users/277adb39cd4b4eaeb8a14cfd02357b07 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:23.782440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.801183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.885808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d24a-f95d-4881-8c73-547ecfd7ad15 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:23.919556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc8c14-e6fc-4b72-acae-8456506b8a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:23.920197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc8c14-e6fc-4b72-acae-8456506b8a61 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.920479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc8c14-e6fc-4b72-acae-8456506b8a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.920755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc8c14-e6fc-4b72-acae-8456506b8a61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.921923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc8c14-e6fc-4b72-acae-8456506b8a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:23.923363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc8c14-e6fc-4b72-acae-8456506b8a61 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:23.924940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 28/52] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:23.930651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:23.962672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5f5b-221a-4180-98a1-f4a40878e5eb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.963722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5f5b-221a-4180-98a1-f4a40878e5eb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.964017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5f5b-221a-4180-98a1-f4a40878e5eb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.965377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 29/53] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:23.970291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a354-8e2f-43b8-871d-89bd63f191f1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:23.970636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a354-8e2f-43b8-871d-89bd63f191f1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:23.970929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a354-8e2f-43b8-871d-89bd63f191f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:23.989272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f333a354-8e2f-43b8-871d-89bd63f191f1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:23.990451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f333a354-8e2f-43b8-871d-89bd63f191f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:24.032245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36872-bceb-42c0-b8cf-9375ab5a945b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.056782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:24.058284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 30/54] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:24.065362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.066006 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.066297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.067329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.067413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.domain.id=default, user.id=277adb39cd4b4eaeb8a14cfd02357b07) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:24.067665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.069150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.078765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 25/55] 10.222.0.71 () {56 vars in 1322 bytes} [Tue Aug 2 09:02:23 2022] GET /identity/v3/role_assignments?user.id=277adb39cd4b4eaeb8a14cfd02357b07&scope.domain.id=default&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:24.082544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a354-8e2f-43b8-871d-89bd63f191f1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.099618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:24.190173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333a354-8e2f-43b8-871d-89bd63f191f1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.226387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d607b8-4460-4fd4-825d-5e4330843aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.227039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d607b8-4460-4fd4-825d-5e4330843aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.227325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d607b8-4460-4fd4-825d-5e4330843aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.227605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d607b8-4460-4fd4-825d-5e4330843aa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.229344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d607b8-4460-4fd4-825d-5e4330843aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.230869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d607b8-4460-4fd4-825d-5e4330843aa4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.232700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 31/56] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:24.238440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:24.343840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0493907-7d42-4f9b-acaf-083bdf53606e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:24.377549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad8b69-6436-4508-b8ce-5e8be2b85328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:24.378188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad8b69-6436-4508-b8ce-5e8be2b85328 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:24.378480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad8b69-6436-4508-b8ce-5e8be2b85328 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:24.378760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad8b69-6436-4508-b8ce-5e8be2b85328 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:24.379558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad8b69-6436-4508-b8ce-5e8be2b85328 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:24.381018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad8b69-6436-4508-b8ce-5e8be2b85328 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:24.456124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 26/57] 10.222.0.71 () {60 vars in 1140 bytes} [Tue Aug 2 09:02:24 2022] POST /identity/v3/projects => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:26.455034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5a28c-c522-43db-9aa8-d214c8bf6b3f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.455572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5a28c-c522-43db-9aa8-d214c8bf6b3f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.455572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5a28c-c522-43db-9aa8-d214c8bf6b3f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.456944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 32/58] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:26.462088 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205e46-0f5d-4bba-b58e-e73f3c7cfe91 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.462469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205e46-0f5d-4bba-b58e-e73f3c7cfe91 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.462664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205e46-0f5d-4bba-b58e-e73f3c7cfe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.481662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f9205e46-0f5d-4bba-b58e-e73f3c7cfe91 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:26.482879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9205e46-0f5d-4bba-b58e-e73f3c7cfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:26.517664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:26.548516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 27/59] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:26.573990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5a28c-c522-43db-9aa8-d214c8bf6b3f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:26.655037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:26.672838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5a28c-c522-43db-9aa8-d214c8bf6b3f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:26.706863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f31d2-920e-4d31-abec-c8ce037eb460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:26.707427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f31d2-920e-4d31-abec-c8ce037eb460 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.707712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f31d2-920e-4d31-abec-c8ce037eb460 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.707989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f31d2-920e-4d31-abec-c8ce037eb460 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.709115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f31d2-920e-4d31-abec-c8ce037eb460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:26.710581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f31d2-920e-4d31-abec-c8ce037eb460 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:26.712133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 33/60] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:26.717656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205e46-0f5d-4bba-b58e-e73f3c7cfe91 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:26.814341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205e46-0f5d-4bba-b58e-e73f3c7cfe91 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:26.848265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3f2c3-137a-4c99-bf19-8c3cfd62141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:26.848873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3f2c3-137a-4c99-bf19-8c3cfd62141c None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:26.849430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3f2c3-137a-4c99-bf19-8c3cfd62141c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:26.849742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3f2c3-137a-4c99-bf19-8c3cfd62141c None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:26.850423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3f2c3-137a-4c99-bf19-8c3cfd62141c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:26.851957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3f2c3-137a-4c99-bf19-8c3cfd62141c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:26.972072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 28/61] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:02:26 2022] POST /identity/v3/users => generated 275 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:30.078129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbd558-2180-4d4d-9c3f-11883b44c8f8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.078635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbd558-2180-4d4d-9c3f-11883b44c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.078714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbd558-2180-4d4d-9c3f-11883b44c8f8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.080035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 34/62] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:30.085384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98aeb-9c3c-41e2-b675-1c7fb7a33103 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.085817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98aeb-9c3c-41e2-b675-1c7fb7a33103 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.086000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d98aeb-9c3c-41e2-b675-1c7fb7a33103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.112307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a5d98aeb-9c3c-41e2-b675-1c7fb7a33103 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:30.113934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a5d98aeb-9c3c-41e2-b675-1c7fb7a33103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:30.159725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:30.225873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 29/63] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:30.254467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbd558-2180-4d4d-9c3f-11883b44c8f8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:30.291637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84f15-f90a-480c-89a7-14cc28a24099 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.292244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84f15-f90a-480c-89a7-14cc28a24099 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.292706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84f15-f90a-480c-89a7-14cc28a24099 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.294515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 30/64] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:30.299521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f205d-d2f6-4bb5-bf4a-8985f288f502 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.300040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f205d-d2f6-4bb5-bf4a-8985f288f502 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.300542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f205d-d2f6-4bb5-bf4a-8985f288f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.326942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7d4f205d-d2f6-4bb5-bf4a-8985f288f502 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:30.328394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7d4f205d-d2f6-4bb5-bf4a-8985f288f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:30.376516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbd558-2180-4d4d-9c3f-11883b44c8f8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:30.413330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:30.414249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.414676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.415109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.419710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 31/65] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:30.421865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72654201-7256-48e6-89c0-0a1deb0309e0 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.427857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:30.430119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72654201-7256-48e6-89c0-0a1deb0309e0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.430564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72654201-7256-48e6-89c0-0a1deb0309e0 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.432970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 32/66] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:30.438529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11cc31-56a0-425b-9626-f0bff9e116f3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:30.438771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:30.439785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:30.440693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:30.441271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11cc31-56a0-425b-9626-f0bff9e116f3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.441271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11cc31-56a0-425b-9626-f0bff9e116f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.442804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 35/67] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:30.449504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:30.467980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:30.469492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ee11cc31-56a0-425b-9626-f0bff9e116f3 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:30.470890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ee11cc31-56a0-425b-9626-f0bff9e116f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:30.542398 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 33/68] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:30.543476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11cc31-56a0-425b-9626-f0bff9e116f3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:30.562921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:30.595720 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e617-ccb8-419d-a5e7-646bdccc6ab7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:30.639491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:30.640488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.641001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.641422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.642511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:30.642820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:30.644389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:30.650034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11cc31-56a0-425b-9626-f0bff9e116f3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:30.653653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 36/69] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:30.657044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:30.687232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84dbd5-d5e0-40d1-876f-ffcdfe33fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:30.687889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84dbd5-d5e0-40d1-876f-ffcdfe33fa73 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.688181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84dbd5-d5e0-40d1-876f-ffcdfe33fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.688472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84dbd5-d5e0-40d1-876f-ffcdfe33fa73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.699667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84dbd5-d5e0-40d1-876f-ffcdfe33fa73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-fe84dbd5-d5e0-40d1-876f-ffcdfe33fa73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:30.704715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:30.705615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:30.706712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 34/70] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:30.707864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4789f-2e92-4c1e-917d-115233cd0447 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.708158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4789f-2e92-4c1e-917d-115233cd0447 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.708444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4789f-2e92-4c1e-917d-115233cd0447 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.709899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 35/71] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:30.710448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4789f-2e92-4c1e-917d-115233cd0447 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:30.738855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:30.768936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3acd68-a525-44bf-ba30-09fb352fde32 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:30.799020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:30.803612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:30.804261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.804557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.804832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.815598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:30.821095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:30.822756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:30.823832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:30.824582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4789f-2e92-4c1e-917d-115233cd0447 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:30.824664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 37/72] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:30.824664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:30.861650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753f7e8-32fe-43e4-a162-e4fdb1f0613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:30.862326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753f7e8-32fe-43e4-a162-e4fdb1f0613b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.862617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753f7e8-32fe-43e4-a162-e4fdb1f0613b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.862902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753f7e8-32fe-43e4-a162-e4fdb1f0613b None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.879243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753f7e8-32fe-43e4-a162-e4fdb1f0613b None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:30.880724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753f7e8-32fe-43e4-a162-e4fdb1f0613b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:30.882529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 36/73] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:30.883712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe491c-f349-4536-b4e5-40a408dbcbc3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.884002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe491c-f349-4536-b4e5-40a408dbcbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.884284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe491c-f349-4536-b4e5-40a408dbcbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.902499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-92fe491c-f349-4536-b4e5-40a408dbcbc3 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:30.903715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-92fe491c-f349-4536-b4e5-40a408dbcbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:30.927956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fa44e-96b2-4d31-9630-a792db85a5fc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:30.958346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:30.964312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:30.965029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.965377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.965667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.968068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:30.968068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:30.968068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:30.969862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 37/74] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:30.971067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf5a04-3c05-4833-9e46-46ef8bc2528e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:30.971366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf5a04-3c05-4833-9e46-46ef8bc2528e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:30.971648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf5a04-3c05-4833-9e46-46ef8bc2528e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:30.972892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 38/75] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:30.973642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf5a04-3c05-4833-9e46-46ef8bc2528e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:30.989744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 38/76] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:30.989744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.046462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.081934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf5a04-3c05-4833-9e46-46ef8bc2528e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.090341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3ca57-2972-49c7-8558-3c59f38e0308 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.115613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d2ac-4109-45aa-98b2-e50513eeeb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.116232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d2ac-4109-45aa-98b2-e50513eeeb16 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.116511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d2ac-4109-45aa-98b2-e50513eeeb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.116785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d2ac-4109-45aa-98b2-e50513eeeb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.117500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d2ac-4109-45aa-98b2-e50513eeeb16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:31.117833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d2ac-4109-45aa-98b2-e50513eeeb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.120032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d2ac-4109-45aa-98b2-e50513eeeb16 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.124154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.124769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.125056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.125328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.127975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 39/77] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:31.129112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd2e7-8b60-43a5-94bf-b2ba7fa7bc6c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.129400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd2e7-8b60-43a5-94bf-b2ba7fa7bc6c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.129676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd2e7-8b60-43a5-94bf-b2ba7fa7bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.147611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-beebd2e7-8b60-43a5-94bf-b2ba7fa7bc6c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:31.148916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-beebd2e7-8b60-43a5-94bf-b2ba7fa7bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:31.191374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.199463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.200941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.219832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 40/78] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:31.219832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebd2e7-8b60-43a5-94bf-b2ba7fa7bc6c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.275585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.315899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 39/79] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:31.316754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.318220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebd2e7-8b60-43a5-94bf-b2ba7fa7bc6c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.352190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.352826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.353115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.354134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] PATH_INFO: `/v3/users/277adb39cd4b4eaeb8a14cfd02357b07` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.355301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] RBAC: Authorizing `identity:get_user(user_id=277adb39cd4b4eaeb8a14cfd02357b07)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.356757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.358390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 41/80] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/users/277adb39cd4b4eaeb8a14cfd02357b07 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:31.359157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.417020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.423644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ce12-5a45-4ea6-845b-7e38fbd5add4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.456772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8ba1-8e10-40ef-93aa-1fe6a361f733 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.457440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.458117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.458400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.458676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.469534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:31.474806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:31.475825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:31.476600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 40/81] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:31.477836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.486718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.496827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.500161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.500161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.500161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.500161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.500782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.502426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 42/82] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:31.503186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.585575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29f02-ee5f-455a-96f7-bf14c933f74d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.605116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d435-cf08-4ac6-9207-dd22e950d4ac None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.618802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.619665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.619954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.620234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.621386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.622898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.628947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 41/83] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:31.628947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.639635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.640275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.640563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.640838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.642031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.643471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.645114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 43/84] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:31.645902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.653357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.705587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.730957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160db1-f6ea-46ee-8893-ad9f86645916 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.744117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554033d-417b-4a9b-bea1-6ccbd1faf86a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.764212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.764835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.765130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.765488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.778542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.779158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.779446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.779734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.780447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:31.780753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.782158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.790065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 44/85] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:31.790880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.837981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:31.839464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:31.862650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.892436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99a8f-b553-4f88-a3dd-afff64351186 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:31.915844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:31.927414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:31.928061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:31.928351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:31.928631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:31.941082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 42/86] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:31.942107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:31.998866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.000390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.043744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d1d2-de5c-475e-b128-b1387a92fec0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.066735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.078855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.079543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.079833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.080114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.080803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.082327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.099935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 45/87] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:32.099935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.125341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.180913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 43/88] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:02:31 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:32.182410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.206222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11767bc6-2c6c-4a77-a687-9a2c4425c1d5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.246965 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.247604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.247894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.248180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.249060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=3b45245f45504e11bd9ec34cfbb1962c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:32.249323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.250854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.256924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 46/89] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/role_assignments?user.id=3b45245f45504e11bd9ec34cfbb1962c&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:32.257900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.312975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f18e2-394b-4f67-bbca-0ff311691ebd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.355855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.356906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.357387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.357898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.359416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.361160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.362921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 44/90] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:32.363711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.377145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.390682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac3bbf-191c-4038-bf29-7dfa2e425f15 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.430969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.441163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.442317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.442610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.442893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.444074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.445526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.447394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 47/91] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:32.448167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.508187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449077-7394-423d-af98-c75006e6d918 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.557557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.558329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.558621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.558901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.560328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.562272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.564513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 45/92] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:32.569495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.588465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975c61-4ea5-46fd-a10e-8bd3e25c44e5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.645145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.646341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.647291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.648070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.685525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.699833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7b4d6-586f-4894-b9ac-df0e205b46c3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:32.716848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:32.740219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:32.740901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:32.741245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:32.741528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:32.742413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=277adb39cd4b4eaeb8a14cfd02357b07) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:32.742729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.744998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.749460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:32.750891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 46/93] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/role_assignments?user.id=277adb39cd4b4eaeb8a14cfd02357b07&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:32.751634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:32.751956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.881816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 48/94] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:32.891104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:32.964002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:33.019728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7008e-c9b3-4102-83c6-178a6b0d6179 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:33.032059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c679aaa-fec3-4d16-ab1f-a0f05162b3a4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:33.058194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:33.058994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:33.059383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:33.059768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] PATH_INFO: `/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:33.061066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] RBAC: Authorizing `identity:get_project(project_id=ed80dd433e9345a6902ccaecb1c1b69d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:33.062649 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:33.064624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 49/95] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:33.070478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:33.094465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837ac86-46c1-45b9-8c82-5398c43d6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:33.095125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ac86-46c1-45b9-8c82-5398c43d6701 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:33.095420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ac86-46c1-45b9-8c82-5398c43d6701 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:33.095712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ac86-46c1-45b9-8c82-5398c43d6701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:33.096530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837ac86-46c1-45b9-8c82-5398c43d6701 None admin] RBAC: Adding query filter params (role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=3b45245f45504e11bd9ec34cfbb1962c) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:33.096852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837ac86-46c1-45b9-8c82-5398c43d6701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:33.098377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837ac86-46c1-45b9-8c82-5398c43d6701 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:33.105276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 47/96] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:32 2022] GET /identity/v3/role_assignments?user.id=3b45245f45504e11bd9ec34cfbb1962c&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=db362c02a23549c9815e38259950ff5c => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:33.223460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47aad-faba-4d80-bfa8-eb5c280c4e22 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:33.256718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:33.268215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886789f-69dd-4350-9987-fdaad0f831ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:33.269159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886789f-69dd-4350-9987-fdaad0f831ba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:33.269642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886789f-69dd-4350-9987-fdaad0f831ba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:33.270167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886789f-69dd-4350-9987-fdaad0f831ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:33.271174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886789f-69dd-4350-9987-fdaad0f831ba None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=ed80dd433e9345a6902ccaecb1c1b69d, user.id=3b45245f45504e11bd9ec34cfbb1962c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:33.271749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886789f-69dd-4350-9987-fdaad0f831ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:33.273433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886789f-69dd-4350-9987-fdaad0f831ba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:33.280837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 50/97] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:33 2022] GET /identity/v3/role_assignments?user.id=3b45245f45504e11bd9ec34cfbb1962c&scope.project.id=ed80dd433e9345a6902ccaecb1c1b69d&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:35.048606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadb810-6d26-49ae-9a21-448ea8e3614e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.049104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadb810-6d26-49ae-9a21-448ea8e3614e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.049175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadb810-6d26-49ae-9a21-448ea8e3614e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.050693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 48/98] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:35.056802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e80b5-9544-42c0-9c7f-03936e001848 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.057956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e80b5-9544-42c0-9c7f-03936e001848 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.058464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e80b5-9544-42c0-9c7f-03936e001848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.087395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-130e80b5-9544-42c0-9c7f-03936e001848 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:35.089921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-130e80b5-9544-42c0-9c7f-03936e001848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:35.149055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161e7d-5f42-4145-836f-878543e10b9d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.149325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161e7d-5f42-4145-836f-878543e10b9d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.149561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161e7d-5f42-4145-836f-878543e10b9d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.151161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 49/99] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:35.169766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c8e74-aefb-4ab1-af66-f840dd6d9774 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.169938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c8e74-aefb-4ab1-af66-f840dd6d9774 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.170161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c8e74-aefb-4ab1-af66-f840dd6d9774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.186526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 51/100] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:35.207257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-597c8e74-aefb-4ab1-af66-f840dd6d9774 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:35.208502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-597c8e74-aefb-4ab1-af66-f840dd6d9774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:35.209038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e80b5-9544-42c0-9c7f-03936e001848 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.270577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:35.315725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e80b5-9544-42c0-9c7f-03936e001848 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:35.319074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 50/101] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:35.338148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:35.353058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:35.354368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.354810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.355097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.361520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c8e74-aefb-4ab1-af66-f840dd6d9774 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.366515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:35.371957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:35.372817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:35.373991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 52/102] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:35.379688 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.485036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c8e74-aefb-4ab1-af66-f840dd6d9774 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:35.491565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540b24d-f2ae-4ca8-9468-99b500c7fed1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:35.532168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3612f4-c004-471f-a4c3-6cdd6f7596c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:35.532821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3612f4-c004-471f-a4c3-6cdd6f7596c9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.533118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3612f4-c004-471f-a4c3-6cdd6f7596c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.533403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3612f4-c004-471f-a4c3-6cdd6f7596c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.534201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3612f4-c004-471f-a4c3-6cdd6f7596c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:35.534515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3612f4-c004-471f-a4c3-6cdd6f7596c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:35.536153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3612f4-c004-471f-a4c3-6cdd6f7596c9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:35.546009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 53/103] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:35.551350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320757ac-716f-4342-b864-84f5cd8733b2 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.551678 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320757ac-716f-4342-b864-84f5cd8733b2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.552025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320757ac-716f-4342-b864-84f5cd8733b2 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.553487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 54/104] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:35.555074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320757ac-716f-4342-b864-84f5cd8733b2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.559383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636e11e-132d-4f0e-9d9c-5fa233088422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:35.560053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636e11e-132d-4f0e-9d9c-5fa233088422 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.560344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636e11e-132d-4f0e-9d9c-5fa233088422 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.560627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636e11e-132d-4f0e-9d9c-5fa233088422 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.582816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636e11e-132d-4f0e-9d9c-5fa233088422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9636e11e-132d-4f0e-9d9c-5fa233088422 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:35.587917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:35.588873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:35.590105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 51/105] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:35.603066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c191f1-f19b-4d95-b048-bacbc98aa98d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.603443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c191f1-f19b-4d95-b048-bacbc98aa98d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.603716 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c191f1-f19b-4d95-b048-bacbc98aa98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.604294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:35.642754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-01c191f1-f19b-4d95-b048-bacbc98aa98d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:35.644004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-01c191f1-f19b-4d95-b048-bacbc98aa98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:35.667833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320757ac-716f-4342-b864-84f5cd8733b2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:35.688522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:35.705862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:35.706768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.707139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.707622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.708997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:35.710564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:35.712908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 55/106] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:35.713694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.754246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 52/107] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:35.755919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1a6d-4e18-4079-bf6f-2837dc910438 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.756383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1a6d-4e18-4079-bf6f-2837dc910438 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.756837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1a6d-4e18-4079-bf6f-2837dc910438 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.763346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 53/108] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:35.763346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1a6d-4e18-4079-bf6f-2837dc910438 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.844605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9829-6366-45ec-8281-ea59a342101e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:35.856809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:35.896160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ecfd-9064-4faf-b977-071ed28d1e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:35.897425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ecfd-9064-4faf-b977-071ed28d1e3d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.898058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ecfd-9064-4faf-b977-071ed28d1e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.898899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ecfd-9064-4faf-b977-071ed28d1e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.899789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ecfd-9064-4faf-b977-071ed28d1e3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:35.900454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1a6d-4e18-4079-bf6f-2837dc910438 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:35.902424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ecfd-9064-4faf-b977-071ed28d1e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:35.902976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ecfd-9064-4faf-b977-071ed28d1e3d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:35.915069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 56/109] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:35.918174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee64e6-c603-42d0-9afe-1e15816178de None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.918852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee64e6-c603-42d0-9afe-1e15816178de None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.919239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee64e6-c603-42d0-9afe-1e15816178de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.939796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:35.940755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:35.941044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:35.941327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:35.942544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:35.944007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:35.950934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 54/110] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:35.951838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:35.957823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-18ee64e6-c603-42d0-9afe-1e15816178de None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:35.959318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-18ee64e6-c603-42d0-9afe-1e15816178de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:35.985915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:36.045264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 57/111] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:36.046464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee64e6-c603-42d0-9afe-1e15816178de None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:36.091697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab29cc2-2f65-493b-ad80-8693f198894f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:36.128988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:36.129654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.130079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.130280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.131486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:36.132999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:36.135636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 55/112] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:36.136329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:36.173428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:36.176882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee64e6-c603-42d0-9afe-1e15816178de None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:36.215418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:36.216157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.216518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.217059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] PATH_INFO: `/v3/users/29b9b4c06879449ea0027d5365ade3cb` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.232917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] RBAC: Authorizing `identity:get_user(user_id=29b9b4c06879449ea0027d5365ade3cb)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:36.234150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:36.235971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 58/113] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:36 2022] GET /identity/v3/users/29b9b4c06879449ea0027d5365ade3cb => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:36.236920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:36.267224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:36.272759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd76c4-1453-4b94-8f0a-3fd894dd50f2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:36.327910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:36.329425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.330007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.330469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/3b45245f45504e11bd9ec34cfbb1962c/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.333785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c668f8c374fa4ad5b058c689b07b7672, user_id=3b45245f45504e11bd9ec34cfbb1962c, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:36.335721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:36.356786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f63fd3-787c-41b6-b681-b8e28cf566a8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:36.390217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:36.390901 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.391187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.391466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.402394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:36.407863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:36.408889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 59/114] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:02:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:36.409877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:36.423400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 56/115] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:36 2022] PUT /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/3b45245f45504e11bd9ec34cfbb1962c/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:36.424873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:36.432508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:36.531936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38477-8848-41a0-9e16-e5bc0ca52d68 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:36.546771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4526ae-7bc4-4f98-8170-2bd6a78779d3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:36.572768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6f3b-c4ef-48cd-b832-4577e701b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:36.573407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6f3b-c4ef-48cd-b832-4577e701b1dc None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.573694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6f3b-c4ef-48cd-b832-4577e701b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.574037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6f3b-c4ef-48cd-b832-4577e701b1dc None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.574732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6f3b-c4ef-48cd-b832-4577e701b1dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:36.577183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6f3b-c4ef-48cd-b832-4577e701b1dc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:36.587487 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f350f-3321-46a5-a0c3-92cfcb2c97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:36.588015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f350f-3321-46a5-a0c3-92cfcb2c97da None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.588303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f350f-3321-46a5-a0c3-92cfcb2c97da None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.588600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f350f-3321-46a5-a0c3-92cfcb2c97da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.616557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:36.660778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 60/116] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:02:36 2022] POST /identity/v3/projects => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:36.660778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3792f4-94b2-400c-9d5b-16137308c2de None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.660778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3792f4-94b2-400c-9d5b-16137308c2de None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.660778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3792f4-94b2-400c-9d5b-16137308c2de None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.660778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 61/117] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:36.660778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3792f4-94b2-400c-9d5b-16137308c2de None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:36.669342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f350f-3321-46a5-a0c3-92cfcb2c97da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:36.670944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f350f-3321-46a5-a0c3-92cfcb2c97da None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:36.747189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:36.786849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3792f4-94b2-400c-9d5b-16137308c2de None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:36.820530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 57/118] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:36.822844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6251c2-9446-4768-9dbf-c27480f31911 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.823416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6251c2-9446-4768-9dbf-c27480f31911 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.823895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6251c2-9446-4768-9dbf-c27480f31911 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.825517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 58/119] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:36.830639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d2241-faaf-4cc4-9372-b52f4eb35dc4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.830930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d2241-faaf-4cc4-9372-b52f4eb35dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.831263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d2241-faaf-4cc4-9372-b52f4eb35dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.847113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:36.848348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.848833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.849609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.851938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:36.852478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:36.852604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b89d2241-faaf-4cc4-9372-b52f4eb35dc4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:36.856803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:36.857174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b89d2241-faaf-4cc4-9372-b52f4eb35dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:36.866518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 62/120] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:02:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:36.866518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:36.938138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:36.952001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 59/121] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:36.953554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e24b2-94dc-4fba-8db6-ad0d9b9c721c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:36.954104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e24b2-94dc-4fba-8db6-ad0d9b9c721c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:36.954584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e24b2-94dc-4fba-8db6-ad0d9b9c721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:36.978592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-779e24b2-94dc-4fba-8db6-ad0d9b9c721c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:36.981951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-779e24b2-94dc-4fba-8db6-ad0d9b9c721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:36.985797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646358d7-6c59-424d-b399-5137a71790f1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.019605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:37.025271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.026097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.026489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.026872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.028165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.031153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.033164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 63/122] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:36 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.034160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.064619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 60/123] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:37.066021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e24b2-94dc-4fba-8db6-ad0d9b9c721c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.173064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bcae6-a13e-46e2-a646-1382e2401d80 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.197894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e24b2-94dc-4fba-8db6-ad0d9b9c721c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.218234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:37.224959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.226118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.226510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.227262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.229561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.232062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.234236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 64/124] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.237800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.244368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948746-954c-4152-91ad-003f9874e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.245243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948746-954c-4152-91ad-003f9874e557 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.245757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948746-954c-4152-91ad-003f9874e557 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.246219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948746-954c-4152-91ad-003f9874e557 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.257895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08948746-954c-4152-91ad-003f9874e557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-08948746-954c-4152-91ad-003f9874e557 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:37.264402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:37.265468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:37.266458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:37.268509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 61/125] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:37.269419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948746-954c-4152-91ad-003f9874e557 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.324550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:37.373840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6228ed-6eae-4125-8d90-f80c934b9545 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.386219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948746-954c-4152-91ad-003f9874e557 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.411474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.412646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.413146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.413619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.414731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] RBAC: Adding query filter params (role.id=ac2d9625feb9489d874dbb22baa40e23, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=29b9b4c06879449ea0027d5365ade3cb) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:37.415322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.417114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.423351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.423659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 65/126] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/role_assignments?user.id=29b9b4c06879449ea0027d5365ade3cb&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=ac2d9625feb9489d874dbb22baa40e23 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.423994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.424347 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.424637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.425356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.437403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:37.443289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:37.444324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:37.445089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 62/127] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:37.445744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.491257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:37.564931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d13d-a3ad-4269-9386-754a5511fa39 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.581241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb803-8ac8-4678-aa30-17c8ab6c7d9f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.609228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.609228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.609228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.609228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.609626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:37.609626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.611449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.621468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 63/128] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.622318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.639314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:37.652639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.653370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.658185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.658185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.658185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.658185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.660613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 66/129] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.665772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.752541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:37.756621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d007fed-dfcf-472a-a636-67c444a991e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.779582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acc3a4-6b5d-409e-8622-941b543d58fc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.795924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.797037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.797496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.798022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.798998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:37.799453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.801035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.811345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 64/130] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.812444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.818252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.818984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.819381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.819761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] PATH_INFO: `/v3/users/277adb39cd4b4eaeb8a14cfd02357b07` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.821275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] RBAC: Authorizing `identity:get_user(user_id=277adb39cd4b4eaeb8a14cfd02357b07)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.824003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.825962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 67/131] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/users/277adb39cd4b4eaeb8a14cfd02357b07 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.829764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:37.903553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:37.941411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc995-a113-4b86-a26f-fcd6656cdd39 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:37.983205 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:37.984019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:37.988169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:37.988169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:37.988169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:37.988169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:37.990074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 68/132] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:37.991061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:38.011691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc24d2c-23f8-4178-8464-3f27ee030cb8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:38.086997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:38.088052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.088553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.089086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/3b45245f45504e11bd9ec34cfbb1962c/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.094728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c668f8c374fa4ad5b058c689b07b7672, user_id=3b45245f45504e11bd9ec34cfbb1962c, role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:38.096370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:38.107325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ca4d-22c5-40ae-8659-172b0fa7812f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:38.143884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:38.144712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.146163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.146163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.146835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:38.148389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:38.150897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 69/133] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:37 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:38.151941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:38.155985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:38.220126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 65/134] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:37 2022] PUT /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/3b45245f45504e11bd9ec34cfbb1962c/roles/db362c02a23549c9815e38259950ff5c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:38.221750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:38.266151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2d050-7ebe-41a3-80e9-af6b43ce0fbb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:38.302107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:38.308858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:38.309589 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.309913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.310246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] PATH_INFO: `/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.312207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] RBAC: Authorizing `identity:get_project(project_id=ed80dd433e9345a6902ccaecb1c1b69d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:38.313702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:38.315642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 70/135] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:38 2022] GET /identity/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:38.322631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:38.425024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:38.460618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109fdb-23ca-45b9-8488-e0fd747f96b5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:38.508627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923487d3-9631-4fe5-a330-31cc74276f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:38.509361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923487d3-9631-4fe5-a330-31cc74276f2c None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.509661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923487d3-9631-4fe5-a330-31cc74276f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.510175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923487d3-9631-4fe5-a330-31cc74276f2c None admin] PATH_INFO: `/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d/users/3b45245f45504e11bd9ec34cfbb1962c/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.515382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923487d3-9631-4fe5-a330-31cc74276f2c None admin] RBAC: Authorizing `identity:create_grant(project_id=ed80dd433e9345a6902ccaecb1c1b69d, user_id=3b45245f45504e11bd9ec34cfbb1962c, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:38.517078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923487d3-9631-4fe5-a330-31cc74276f2c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:38.541982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c7a97-b545-4cc0-8f66-319e4011e5d3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:38.610916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 71/136] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:38 2022] PUT /identity/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d/users/3b45245f45504e11bd9ec34cfbb1962c/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:02:38.613688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:38.614477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.614774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.615062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/277adb39cd4b4eaeb8a14cfd02357b07/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.620918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] RBAC: Authorizing `identity:create_grant(project_id=c668f8c374fa4ad5b058c689b07b7672, user_id=277adb39cd4b4eaeb8a14cfd02357b07, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:38.622634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:38.718343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61040d-4f9e-42f1-946e-bbe089ce2ce8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.718662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61040d-4f9e-42f1-946e-bbe089ce2ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.718908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61040d-4f9e-42f1-946e-bbe089ce2ce8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.720462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 72/137] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:38.726664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317109a7-cdf8-49ba-a8be-ce6d4b3ed90a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:38.727231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317109a7-cdf8-49ba-a8be-ce6d4b3ed90a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:38.727712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317109a7-cdf8-49ba-a8be-ce6d4b3ed90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:38.731188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 66/138] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:38 2022] PUT /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/277adb39cd4b4eaeb8a14cfd02357b07/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:38.758200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-317109a7-cdf8-49ba-a8be-ce6d4b3ed90a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:38.759957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-317109a7-cdf8-49ba-a8be-ce6d4b3ed90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:38.862569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 73/139] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:38.907050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:39.008051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfbefe-aa6c-4e8a-b379-985b663e539c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.008320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfbefe-aa6c-4e8a-b379-985b663e539c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.008602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfbefe-aa6c-4e8a-b379-985b663e539c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.010939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 74/140] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:39.014653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:39.016898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152468e8-5f4a-4356-ba5a-d8d7b26dc223 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.017191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152468e8-5f4a-4356-ba5a-d8d7b26dc223 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.017470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152468e8-5f4a-4356-ba5a-d8d7b26dc223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.036784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4dd6-df82-4e31-8cff-855648a6bb84 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:39.047460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-152468e8-5f4a-4356-ba5a-d8d7b26dc223 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:39.048662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-152468e8-5f4a-4356-ba5a-d8d7b26dc223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:39.085450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:39.087563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.087858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.088139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.108269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:39.113851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:39.114689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:39.115586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 67/141] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:39.126949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:39.163834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:39.181139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 75/142] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:39.221876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152468e8-5f4a-4356-ba5a-d8d7b26dc223 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:39.273349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771c7b1-220e-4ce2-9fb8-21384403912e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:39.329165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:39.329829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.330124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.330402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.331134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:39.331441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:39.332854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:39.351516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 68/143] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:39.357485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:39.359341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152468e8-5f4a-4356-ba5a-d8d7b26dc223 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:39.366189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:39.398684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:39.399331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.399634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.400711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.402062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:39.403524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:39.405491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 76/144] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:39.410584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:39.475358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:39.494608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35c4d-9da1-4115-aca3-f119ee605105 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:39.518468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd89107-6a8b-4021-afd5-6951edf3460a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:39.555606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:39.556976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.557376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.558328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.559156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:39.560714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:39.564071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:39.564944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.565388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.565856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.567309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:39.568990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:39.576190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 69/145] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:39 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:39.577354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:39.670151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 77/146] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:02:39 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:02:39.683840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:39.724993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd816b75-544b-49e7-9067-c740cb030cac None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:39.762767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:39.763413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:39.763701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:39.763984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:39.839001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:39.840494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:39.934242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:39.944412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 70/147] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:39.955070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:40.132334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d17d-0145-4308-bee7-cc3bcd918e3a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:40.160166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:40.195564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0373482-331d-4bcd-bf45-b555f9bd469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:40.196139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0373482-331d-4bcd-bf45-b555f9bd469a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:40.196422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0373482-331d-4bcd-bf45-b555f9bd469a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:40.196717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0373482-331d-4bcd-bf45-b555f9bd469a None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:40.200928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0373482-331d-4bcd-bf45-b555f9bd469a None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:40.202447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0373482-331d-4bcd-bf45-b555f9bd469a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:40.204152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 78/148] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:39 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:40.214918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:40.355017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebe48-a579-4721-9e47-5e11c9d131d7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:40.394780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c08ed9-ef15-454b-aca0-7fcaf0de1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:40.395413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c08ed9-ef15-454b-aca0-7fcaf0de1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:40.395703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c08ed9-ef15-454b-aca0-7fcaf0de1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:40.395988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c08ed9-ef15-454b-aca0-7fcaf0de1ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:40.396784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c08ed9-ef15-454b-aca0-7fcaf0de1ce0 None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=3b45245f45504e11bd9ec34cfbb1962c) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:40.397095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c08ed9-ef15-454b-aca0-7fcaf0de1ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:40.398587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c08ed9-ef15-454b-aca0-7fcaf0de1ce0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:40.405272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 71/149] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:40 2022] GET /identity/v3/role_assignments?user.id=3b45245f45504e11bd9ec34cfbb1962c&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:40.607212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdbfb0-5ef4-4491-9529-60e1b35ca807 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:40.607687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdbfb0-5ef4-4491-9529-60e1b35ca807 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:40.607687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdbfb0-5ef4-4491-9529-60e1b35ca807 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:40.609034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 79/150] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:40.614646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c8d2-b71a-4ae8-b8bf-96b765000863 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:40.614937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c8d2-b71a-4ae8-b8bf-96b765000863 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:40.615221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c8d2-b71a-4ae8-b8bf-96b765000863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:40.635318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3d00c8d2-b71a-4ae8-b8bf-96b765000863 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:40.636532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3d00c8d2-b71a-4ae8-b8bf-96b765000863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:40.670911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:40.717126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 72/151] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:40.753561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdbfb0-5ef4-4491-9529-60e1b35ca807 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:40.893280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdbfb0-5ef4-4491-9529-60e1b35ca807 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:40.941239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:40.941954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:40.942241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:40.942508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:40.958706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:40.965138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:40.966067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:40.967275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 80/152] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:40.972198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c8d2-b71a-4ae8-b8bf-96b765000863 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.109757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c8d2-b71a-4ae8-b8bf-96b765000863 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:41.155128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e7ae3-0745-4550-9190-2ffd4dd20ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:41.155690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e7ae3-0745-4550-9190-2ffd4dd20ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.155972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e7ae3-0745-4550-9190-2ffd4dd20ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.156248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e7ae3-0745-4550-9190-2ffd4dd20ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.156977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e7ae3-0745-4550-9190-2ffd4dd20ea0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:41.157282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e7ae3-0745-4550-9190-2ffd4dd20ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:41.158708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e7ae3-0745-4550-9190-2ffd4dd20ea0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:41.168871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 73/153] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:41.174132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.266224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.338151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac93b8-185c-477a-a088-7e0cd8fe73bc None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.338534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac93b8-185c-477a-a088-7e0cd8fe73bc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.338702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac93b8-185c-477a-a088-7e0cd8fe73bc None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.340308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 74/154] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:41.344789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbcab7-b855-4993-8586-ad876b79c344 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:41.347689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae177e-e42d-468f-805e-2a9fe0a59a79 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.347977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae177e-e42d-468f-805e-2a9fe0a59a79 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.348256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae177e-e42d-468f-805e-2a9fe0a59a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.371561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3eae177e-e42d-468f-805e-2a9fe0a59a79 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:41.372775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3eae177e-e42d-468f-805e-2a9fe0a59a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:41.390379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:41.391035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.391322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.391605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] PATH_INFO: `/v3/users/29b9b4c06879449ea0027d5365ade3cb` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.392815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] RBAC: Authorizing `identity:get_user(user_id=29b9b4c06879449ea0027d5365ade3cb)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:41.394308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:41.396214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 81/155] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:41 2022] GET /identity/v3/users/29b9b4c06879449ea0027d5365ade3cb => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:41.401770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.417498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.489683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 75/156] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:41.525700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae177e-e42d-468f-805e-2a9fe0a59a79 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.604952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8904-edec-496a-a467-7acd7219bf56 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:41.631787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.694429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:41.694991 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae177e-e42d-468f-805e-2a9fe0a59a79 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:41.695098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.695405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.695681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.696933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:41.698717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:41.700387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 82/157] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:41 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:41.705911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.760453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444f97-bd5c-40e5-aefe-e82c448a077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:41.761111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444f97-bd5c-40e5-aefe-e82c448a077b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.761398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444f97-bd5c-40e5-aefe-e82c448a077b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.761679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444f97-bd5c-40e5-aefe-e82c448a077b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.783324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53444f97-bd5c-40e5-aefe-e82c448a077b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-53444f97-bd5c-40e5-aefe-e82c448a077b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:41.788393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:41.789282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:41.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 76/158] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:41.792647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43f2a-53f3-4ae3-8d94-ba9cdb549b31 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:41.792647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43f2a-53f3-4ae3-8d94-ba9cdb549b31 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:41.792647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43f2a-53f3-4ae3-8d94-ba9cdb549b31 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:41.803980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 77/159] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:41.811440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43f2a-53f3-4ae3-8d94-ba9cdb549b31 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:41.854862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:41.929040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b895-9c36-4caa-a26b-48dff3471ad5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.007407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a38065-b859-4ac6-ad22-c32d40078fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.008003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38065-b859-4ac6-ad22-c32d40078fed None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.008286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38065-b859-4ac6-ad22-c32d40078fed None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.008561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38065-b859-4ac6-ad22-c32d40078fed None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/29b9b4c06879449ea0027d5365ade3cb/roles/ac2d9625feb9489d874dbb22baa40e23` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.013958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a38065-b859-4ac6-ad22-c32d40078fed None admin] RBAC: Authorizing `identity:create_grant(project_id=c668f8c374fa4ad5b058c689b07b7672, user_id=29b9b4c06879449ea0027d5365ade3cb, role_id=ac2d9625feb9489d874dbb22baa40e23)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.015424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a38065-b859-4ac6-ad22-c32d40078fed None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.053386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43f2a-53f3-4ae3-8d94-ba9cdb549b31 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.104882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 83/160] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:41 2022] PUT /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672/users/29b9b4c06879449ea0027d5365ade3cb/roles/ac2d9625feb9489d874dbb22baa40e23 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:42.106209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae3c3-9616-4f57-93d0-87e5e57cec34 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.106552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae3c3-9616-4f57-93d0-87e5e57cec34 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.106830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae3c3-9616-4f57-93d0-87e5e57cec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.127516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.128175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.128460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.128742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.129518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:42.129857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.131813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.157056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 78/161] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:42.157834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-44cae3c3-9616-4f57-93d0-87e5e57cec34 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:42.159125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-44cae3c3-9616-4f57-93d0-87e5e57cec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:42.163855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:42.272432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:42.296056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:42.313368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84debe-cb26-492b-9716-f33a3220a8a5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.350035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.350737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.351008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.351238 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 84/162] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:42.351353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.352721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.352943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb0d95-17d1-4044-82f7-9296490126d0 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.353240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb0d95-17d1-4044-82f7-9296490126d0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.353527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb0d95-17d1-4044-82f7-9296490126d0 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.354778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.354885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 85/163] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:42.356414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 79/164] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:42 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:42.360362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bd2dd-5539-4956-a812-e457e8cc0898 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.364035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bd2dd-5539-4956-a812-e457e8cc0898 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.364035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bd2dd-5539-4956-a812-e457e8cc0898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.364220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:42.403045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6c8bd2dd-5539-4956-a812-e457e8cc0898 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:42.404273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6c8bd2dd-5539-4956-a812-e457e8cc0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:42.520868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 86/165] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:42.521764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bd2dd-5539-4956-a812-e457e8cc0898 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:42.557314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744b0f-c094-4caa-bbf9-26da661004a1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.632400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.633033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.633317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.633584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.656619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:42.737208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:42.747698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bd2dd-5539-4956-a812-e457e8cc0898 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:42.762569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:42.764087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:42.829135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:42.829836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:42.838617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:42.838617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:42.855270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:42.862675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:42.863557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:42.864530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 87/166] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:42.869293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:42.952841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 80/167] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:42.954324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:43.029353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:43.117840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2007-beae-46ac-9d91-81f67313eed0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:43.129925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f39ec-3e40-4c5e-ab71-e60de7bf280f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:43.187481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:43.189197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:43.190117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:43.191126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:43.192076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:43.193450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:43.195571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:43.197550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:43.200026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:43.200535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:43.201017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:43.217120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 81/168] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:43.222501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:43.229182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:43.241270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:43.242233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:43.243110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:43.248148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 88/169] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:43.249150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:43.292113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:43.392731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105fbd2-d71a-43ea-926b-3905578e2052 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:43.428681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:43.429694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:43.430222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:43.430703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] PATH_INFO: `/v3/users/3b45245f45504e11bd9ec34cfbb1962c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:43.432315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] RBAC: Authorizing `identity:get_user(user_id=3b45245f45504e11bd9ec34cfbb1962c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:43.434010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:43.436237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 89/170] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:43 2022] GET /identity/v3/users/3b45245f45504e11bd9ec34cfbb1962c => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:43.437449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:43.444062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026e732-e533-4ada-ab64-a91bd08d878b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:43.463803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:43.510491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:43.511205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:43.511493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:43.511769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:43.513129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:43.514635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:43.516590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 82/171] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:43 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:43.520017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:43.540313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:43.568589 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276a3b1-f199-49b6-b67c-9a969f4227bc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:43.631514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:43.632299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:43.632586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:43.632863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:43.633588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:43.633918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:43.635977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:43.654408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 90/172] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:43.654969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:43.680434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba755-d272-4498-b94f-0db782c60805 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:43.745574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4b540-63c3-491c-b73f-b98e80c09a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:43.746233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b540-63c3-491c-b73f-b98e80c09a53 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:43.746521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b540-63c3-491c-b73f-b98e80c09a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:43.746801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b540-63c3-491c-b73f-b98e80c09a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:43.833356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:43.840492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13462b03-7ea0-4000-bc03-56996f87046a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:43.881603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4b540-63c3-491c-b73f-b98e80c09a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:43.883261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4b540-63c3-491c-b73f-b98e80c09a53 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:43.883632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:43.885154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:43.885635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:43.886142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:43.887137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] RBAC: Adding query filter params (role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=3b45245f45504e11bd9ec34cfbb1962c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:43.887644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:43.889541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:43.900723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 91/173] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:43 2022] GET /identity/v3/role_assignments?user.id=3b45245f45504e11bd9ec34cfbb1962c&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=db362c02a23549c9815e38259950ff5c => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:43.902778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:43.927581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.059770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7319-24ac-49df-8127-a657dfd0d87b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:44.140241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:44.140743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 83/174] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:44.140974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.141170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.141440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] PATH_INFO: `/v3/users/277adb39cd4b4eaeb8a14cfd02357b07` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.146605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] RBAC: Authorizing `identity:get_user(user_id=277adb39cd4b4eaeb8a14cfd02357b07)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:44.147026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd684b-58a6-488c-a063-bd7a8bf7ff2c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.147527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd684b-58a6-488c-a063-bd7a8bf7ff2c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.147996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd684b-58a6-488c-a063-bd7a8bf7ff2c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.148097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:44.150525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 92/175] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:43 2022] GET /identity/v3/users/277adb39cd4b4eaeb8a14cfd02357b07 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:44.150933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 84/176] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:44.152808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:44.155679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e0d8-e383-4636-ba39-1ae02533f033 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.156177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e0d8-e383-4636-ba39-1ae02533f033 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.156647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e0d8-e383-4636-ba39-1ae02533f033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.195327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bba5e0d8-e383-4636-ba39-1ae02533f033 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:44.197441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bba5e0d8-e383-4636-ba39-1ae02533f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:44.318101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.320011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 85/177] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:44.321065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5e0d8-e383-4636-ba39-1ae02533f033 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:44.330313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbeca-7bd5-476f-be5d-3a150355a088 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:44.332543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.413785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:44.414504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.414787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.415070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] PATH_INFO: `/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.418078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] RBAC: Authorizing `identity:get_project(project_id=ed80dd433e9345a6902ccaecb1c1b69d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:44.419540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:44.421610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 93/178] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:44 2022] GET /identity/v3/projects/ed80dd433e9345a6902ccaecb1c1b69d => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:44.422474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:44.499142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5e0d8-e383-4636-ba39-1ae02533f033 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:44.538484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3812dca-4ccc-47a0-8f82-dd677925136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:44.539085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3812dca-4ccc-47a0-8f82-dd677925136a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.539369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3812dca-4ccc-47a0-8f82-dd677925136a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.539645 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3812dca-4ccc-47a0-8f82-dd677925136a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.551777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72de10-1ca7-47a2-87d1-d8e3f7e0c640 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:44.590357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2822f39-e1e7-4e71-a622-68d7d76a00af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:44.591014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822f39-e1e7-4e71-a622-68d7d76a00af None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.591299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822f39-e1e7-4e71-a622-68d7d76a00af None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.591585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822f39-e1e7-4e71-a622-68d7d76a00af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.602942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2822f39-e1e7-4e71-a622-68d7d76a00af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d2822f39-e1e7-4e71-a622-68d7d76a00af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:44.607930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:44.608816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:44.609878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 94/179] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:44.610989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf89f9-0b12-48c6-8c1b-92326b1bb0c5 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.611241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf89f9-0b12-48c6-8c1b-92326b1bb0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.611476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf89f9-0b12-48c6-8c1b-92326b1bb0c5 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.612745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 95/180] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:44.617322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf89f9-0b12-48c6-8c1b-92326b1bb0c5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:44.620683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3812dca-4ccc-47a0-8f82-dd677925136a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:44.622407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3812dca-4ccc-47a0-8f82-dd677925136a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:44.632784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.635289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.730308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 86/181] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:44.735083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc670ac-e646-4dd5-bd90-012c7ca798e0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.735376 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc670ac-e646-4dd5-bd90-012c7ca798e0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.735656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc670ac-e646-4dd5-bd90-012c7ca798e0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.740751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 87/182] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:44.740751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc670ac-e646-4dd5-bd90-012c7ca798e0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:44.744570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf89f9-0b12-48c6-8c1b-92326b1bb0c5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:44.781765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ed50a-e386-4a99-b1e0-92a6825828ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:44.782313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed50a-e386-4a99-b1e0-92a6825828ff None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.782596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed50a-e386-4a99-b1e0-92a6825828ff None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.782873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed50a-e386-4a99-b1e0-92a6825828ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.784070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ed50a-e386-4a99-b1e0-92a6825828ff None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=ed80dd433e9345a6902ccaecb1c1b69d, user.id=3b45245f45504e11bd9ec34cfbb1962c) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:44.784383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ed50a-e386-4a99-b1e0-92a6825828ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:44.786314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ed50a-e386-4a99-b1e0-92a6825828ff None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:44.794160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 96/183] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:44 2022] GET /identity/v3/role_assignments?user.id=3b45245f45504e11bd9ec34cfbb1962c&scope.project.id=ed80dd433e9345a6902ccaecb1c1b69d&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:44.795402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb1be-6889-473f-a9d0-16a0427da243 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.795693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb1be-6889-473f-a9d0-16a0427da243 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.795971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb1be-6889-473f-a9d0-16a0427da243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.823524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b33eb1be-6889-473f-a9d0-16a0427da243 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:44.825064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b33eb1be-6889-473f-a9d0-16a0427da243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:44.881140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc670ac-e646-4dd5-bd90-012c7ca798e0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:44.893424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.925277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:44.926108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.926505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.926918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.928066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:44.928972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:44.930548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:44.944588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 88/184] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:44.945854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:44.960069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 97/185] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:44.962099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e43c3d-ea53-4433-ba7d-758d8e8126de None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:44.963636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e43c3d-ea53-4433-ba7d-758d8e8126de None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:44.964052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e43c3d-ea53-4433-ba7d-758d8e8126de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:44.980432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:44.987603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-61e43c3d-ea53-4433-ba7d-758d8e8126de None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:44.988856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-61e43c3d-ea53-4433-ba7d-758d8e8126de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:45.067829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 98/186] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:45.068116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e43c3d-ea53-4433-ba7d-758d8e8126de None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.080566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fe227-4a3a-41f1-b59a-fccf24be2e02 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.116495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620ddfb-f0fd-426b-9529-2fb0b4a7b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.117135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ddfb-f0fd-426b-9529-2fb0b4a7b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.117416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ddfb-f0fd-426b-9529-2fb0b4a7b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.117698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ddfb-f0fd-426b-9529-2fb0b4a7b5c7 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.119426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620ddfb-f0fd-426b-9529-2fb0b4a7b5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.120881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620ddfb-f0fd-426b-9529-2fb0b4a7b5c7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.122579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 89/187] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:44 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:45.123687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe434-faa4-4dce-acd4-1aeec9a3fc27 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.123972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe434-faa4-4dce-acd4-1aeec9a3fc27 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.124247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe434-faa4-4dce-acd4-1aeec9a3fc27 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.125462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 90/188] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:45.126289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe434-faa4-4dce-acd4-1aeec9a3fc27 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.167234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.176951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e43c3d-ea53-4433-ba7d-758d8e8126de None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.212308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.213073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.213445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.213759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] PATH_INFO: `/v3/users/f007d4bc3b07479e97c540f22c181ce9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.215682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.227384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe434-faa4-4dce-acd4-1aeec9a3fc27 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.228628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] RBAC: Authorizing `identity:get_user(user_id=f007d4bc3b07479e97c540f22c181ce9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.230151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.231871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 99/189] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/users/f007d4bc3b07479e97c540f22c181ce9 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:45.234567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.263868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.264500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.264779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.265054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.266197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.267654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.269218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 91/190] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:45.273202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.334468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baa5c6-a08b-45ae-b821-b4d069a2b7ee None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.367878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbada83-4430-4d17-8655-005bd8cd7409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.369119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbada83-4430-4d17-8655-005bd8cd7409 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.369314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbada83-4430-4d17-8655-005bd8cd7409 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.369662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbada83-4430-4d17-8655-005bd8cd7409 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.372236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f744-bcd1-40d6-8ca5-c4773c23b34c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.379001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.379987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbada83-4430-4d17-8655-005bd8cd7409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-acbada83-4430-4d17-8655-005bd8cd7409 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:45.385039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:45.386587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 100/191] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:45.387566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1f13-f927-4a9f-af44-9d06170435b7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.388460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1f13-f927-4a9f-af44-9d06170435b7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.388460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1f13-f927-4a9f-af44-9d06170435b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.406664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e21a1f13-f927-4a9f-af44-9d06170435b7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:45.407858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e21a1f13-f927-4a9f-af44-9d06170435b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:45.409394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.410089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.410398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.410654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.411440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=277adb39cd4b4eaeb8a14cfd02357b07) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:45.411750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.413213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.419826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 92/192] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/role_assignments?user.id=277adb39cd4b4eaeb8a14cfd02357b07&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:45.420612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.477112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.498226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 101/193] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:45.507548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1f13-f927-4a9f-af44-9d06170435b7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.538263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a53b79-883c-49b7-b880-2ae7eee5566f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.580822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.581447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.582426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.582426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.632421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.643479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1f13-f927-4a9f-af44-9d06170435b7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.662865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.664332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.678176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.678797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.679083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.679360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.680044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.682365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.763893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 93/194] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:45.764565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.773468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 102/195] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:02:45 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:45.774327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.835923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.842776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:45.883667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc515-e4ce-4118-b818-4916c2752fb5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.917298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed2572-647e-4d00-b08c-7a19f0df9796 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:45.919567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.920203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.920485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.920763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.921502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:45.921844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:45.923255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:45.934052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 94/196] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:45.935088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:45.963371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:45.964017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:45.964297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:45.964569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:45.977005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:45.983085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:45.984163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:45.985041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 103/197] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:45.990613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:46.074102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfafb76-9d07-4158-a4fa-f8384280b317 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:46.112732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:46.114622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:46.119236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:46.119944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd7d7d-3076-4071-ae56-1645bdc31fca None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:46.127483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:46.127483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:46.127483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:46.127483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:46.127483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:46.127483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 95/198] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:46.127951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:46.157645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:46.158242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:46.158522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:46.158795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] PATH_INFO: `/v3/users/f007d4bc3b07479e97c540f22c181ce9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:46.160016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] RBAC: Authorizing `identity:get_user(user_id=f007d4bc3b07479e97c540f22c181ce9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:46.161520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:46.163489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 104/199] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:45 2022] GET /identity/v3/users/f007d4bc3b07479e97c540f22c181ce9 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:46.164294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:46.254184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d28d8-86c9-4f45-9e95-22ee510f7b2b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:46.283043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536c4c-b7c9-4baf-8a22-0379e97842b8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:46.291094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:46.291746 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:46.292091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:46.292369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:46.293136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:46.293447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:46.294996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:46.304451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 96/200] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:46.305200 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:46.329975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:46.331004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:46.331702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:46.332127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:46.333082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=f007d4bc3b07479e97c540f22c181ce9) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:46.333538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:46.335613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:46.343570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 105/201] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:46 2022] GET /identity/v3/role_assignments?user.id=f007d4bc3b07479e97c540f22c181ce9&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:46.344860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:46.406210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:46.410255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:46.487106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afd522-1db1-428c-b701-c9b36f5e87db None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:46.526872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2233b-cf91-4dee-8ea1-3e4f46c68155 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:46.553977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:46.554636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:46.555004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:46.555289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:46.568106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:46.569070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:46.570081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:46.570572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] PATH_INFO: `/v3/users/29b9b4c06879449ea0027d5365ade3cb` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:46.572294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] RBAC: Authorizing `identity:get_user(user_id=29b9b4c06879449ea0027d5365ade3cb)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:46.574537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:46.576726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 106/202] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:46 2022] GET /identity/v3/users/29b9b4c06879449ea0027d5365ade3cb => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:46.581787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:46.690136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:46.691650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:46.719174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:46.725291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bf342-3381-407a-b7ae-3d579ceb6df0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:46.770358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:46.770987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:46.771275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:46.771549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:46.804501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:46.844920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 97/203] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:46.855482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:46.879110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:46.880726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:47.006412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c052e6d-e9b4-409a-8869-76c0444f2a48 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:47.036930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 107/204] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:47.310191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:47.310191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:47.310415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:47.310415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:47.310415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:47.310415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:47.310714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:47.310714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:47.310714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 98/205] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:46 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:47.310714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:47.310714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:47.311033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98fb21-979b-47d2-8ce5-59033b03e930 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:47.311111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a008e-d9e3-40f3-a0f7-7c969e678ec8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:47.311190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:47.311190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:47.311190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:47.311190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:47.311447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:47.311447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:47.311447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 108/206] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:47 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:47.311637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7663e64-2cc0-423e-be11-ff101b5d974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:47.311637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7663e64-2cc0-423e-be11-ff101b5d974b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:47.311637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7663e64-2cc0-423e-be11-ff101b5d974b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:47.311637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7663e64-2cc0-423e-be11-ff101b5d974b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:47.311897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7663e64-2cc0-423e-be11-ff101b5d974b None admin] RBAC: Adding query filter params (role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=f007d4bc3b07479e97c540f22c181ce9) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:47.311897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7663e64-2cc0-423e-be11-ff101b5d974b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:47.311897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7663e64-2cc0-423e-be11-ff101b5d974b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:47.312074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:47.312151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 99/207] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:47 2022] GET /identity/v3/role_assignments?user.id=f007d4bc3b07479e97c540f22c181ce9&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=db362c02a23549c9815e38259950ff5c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:47.377630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:47.430623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012390-a918-4087-a99d-7a17a55a40a9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:47.488405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb97874-0be4-411c-998c-9ca82b9369f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:47.489049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97874-0be4-411c-998c-9ca82b9369f5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:47.489339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97874-0be4-411c-998c-9ca82b9369f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:47.489618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97874-0be4-411c-998c-9ca82b9369f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:47.490461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb97874-0be4-411c-998c-9ca82b9369f5 None admin] RBAC: Adding query filter params (role.id=ac2d9625feb9489d874dbb22baa40e23, scope.project.id=c668f8c374fa4ad5b058c689b07b7672, user.id=29b9b4c06879449ea0027d5365ade3cb) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:47.490775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb97874-0be4-411c-998c-9ca82b9369f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:47.492216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb97874-0be4-411c-998c-9ca82b9369f5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:47.499122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 109/208] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:47 2022] GET /identity/v3/role_assignments?user.id=29b9b4c06879449ea0027d5365ade3cb&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=ac2d9625feb9489d874dbb22baa40e23 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:48.153328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8b48-58cf-4e2e-a8f5-5a56f64a6e92 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.154324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8b48-58cf-4e2e-a8f5-5a56f64a6e92 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.154975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8b48-58cf-4e2e-a8f5-5a56f64a6e92 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.156537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 100/209] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:48.161893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538b60b-0889-432e-b730-55f2f3a308e9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.162291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538b60b-0889-432e-b730-55f2f3a308e9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.162480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538b60b-0889-432e-b730-55f2f3a308e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.184624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2538b60b-0889-432e-b730-55f2f3a308e9 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:48.186675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2538b60b-0889-432e-b730-55f2f3a308e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:48.263509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 110/210] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:48.284210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930f67-24a1-490c-878d-2ea785d1e0db None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.284568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930f67-24a1-490c-878d-2ea785d1e0db None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.284855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930f67-24a1-490c-878d-2ea785d1e0db None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.285921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538b60b-0889-432e-b730-55f2f3a308e9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:48.286537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 101/211] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:48.291802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36c6a-bdb0-477b-9e6b-bffaa563b914 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.292092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36c6a-bdb0-477b-9e6b-bffaa563b914 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.292374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36c6a-bdb0-477b-9e6b-bffaa563b914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.312916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6eb36c6a-bdb0-477b-9e6b-bffaa563b914 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:48.314138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6eb36c6a-bdb0-477b-9e6b-bffaa563b914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:48.367925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:48.396578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 102/212] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:48.418660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538b60b-0889-432e-b730-55f2f3a308e9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:48.420404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36c6a-bdb0-477b-9e6b-bffaa563b914 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:48.448417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:48.468381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:48.469357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.469872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.470367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.483940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:48.489679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:48.490593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:48.491412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:48.494553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 111/213] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:48.500582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:48.537859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36c6a-bdb0-477b-9e6b-bffaa563b914 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:48.578100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:48.578637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.578920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.579198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.582430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:48.584666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:48.587958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 103/214] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:48.593572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:48.617824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca119e7-3d09-4d8f-be94-f15a9bfa5c87 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:48.646894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:48.664648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:48.665395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.665950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.666239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.666992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:48.667691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:48.669203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:48.681460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 112/215] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:48.686727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:48.727651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:48.738845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b29b2a-de71-4a06-8a01-be2684b1e150 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:48.782617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ced6d-e50b-4d2f-a9ea-3301c3c6aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:48.783238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ced6d-e50b-4d2f-a9ea-3301c3c6aab8 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.783518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ced6d-e50b-4d2f-a9ea-3301c3c6aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.783792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ced6d-e50b-4d2f-a9ea-3301c3c6aab8 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.784579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ced6d-e50b-4d2f-a9ea-3301c3c6aab8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:48.786184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ced6d-e50b-4d2f-a9ea-3301c3c6aab8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:48.808380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e29cf-2f97-4772-8794-9b4580ae0b70 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:48.842360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda6b8c-780d-453e-a56c-abee60045a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:48.843083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda6b8c-780d-453e-a56c-abee60045a17 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.843374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda6b8c-780d-453e-a56c-abee60045a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.843652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda6b8c-780d-453e-a56c-abee60045a17 None admin] PATH_INFO: `/v3/users/e3ba1cb473cf45a3895a198919887e59` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.857672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda6b8c-780d-453e-a56c-abee60045a17 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ba1cb473cf45a3895a198919887e59)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:48.860166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda6b8c-780d-453e-a56c-abee60045a17 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:48.861315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 113/216] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:48 2022] GET /identity/v3/users/e3ba1cb473cf45a3895a198919887e59 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:48.862655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533437b-bfd9-48c9-b6d0-87a8aa393aae None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.862942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533437b-bfd9-48c9-b6d0-87a8aa393aae None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.863218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533437b-bfd9-48c9-b6d0-87a8aa393aae None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.868747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 114/217] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:48.868747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533437b-bfd9-48c9-b6d0-87a8aa393aae None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:48.890111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 104/218] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:02:48 2022] POST /identity/v3/users => generated 297 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:02:48.891565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2239ab-b0fb-4033-a327-54d0230222d6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:48.892710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2239ab-b0fb-4033-a327-54d0230222d6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:48.892710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2239ab-b0fb-4033-a327-54d0230222d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:48.912822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8d2239ab-b0fb-4033-a327-54d0230222d6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:48.914387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8d2239ab-b0fb-4033-a327-54d0230222d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:48.934526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:49.008169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 105/219] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:49.024257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533437b-bfd9-48c9-b6d0-87a8aa393aae None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:49.034918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2239ab-b0fb-4033-a327-54d0230222d6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:49.071299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:49.072390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.072852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.073213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.146997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:49.174419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:49.175510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2239ab-b0fb-4033-a327-54d0230222d6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:49.176073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:49.222443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:49.223028 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.226096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.226590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.231559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:49.243118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:49.250166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:49.251165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:49.251943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 106/220] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:49.258559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:49.315792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 115/221] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:49.322228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:49.397266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095363-851f-41a8-bf23-4ab62de4f405 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:49.464458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:49.465088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.465372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.465646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.466412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:49.466711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:49.468135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:49.476382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:49.483671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c582a5-9ff2-4489-b70f-30d8a299eaec None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:49.487033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 107/222] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:49.495665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:49.599098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:49.600018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.600305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.600585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.606653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:49.608171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:49.610179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 116/223] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:49 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:49.616207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:49.616561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66ce9-c3e8-423f-ae69-0329940e72c0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:49.643931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:49.658629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f2c1-afbb-425d-a286-88e7e8c663be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:49.659673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f2c1-afbb-425d-a286-88e7e8c663be None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.660144 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f2c1-afbb-425d-a286-88e7e8c663be None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.661067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f2c1-afbb-425d-a286-88e7e8c663be None admin] PATH_INFO: `/v3/users/f007d4bc3b07479e97c540f22c181ce9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.662992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295f2c1-afbb-425d-a286-88e7e8c663be None admin] RBAC: Authorizing `identity:get_user(user_id=f007d4bc3b07479e97c540f22c181ce9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:49.664768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295f2c1-afbb-425d-a286-88e7e8c663be None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:49.668245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 108/224] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:49 2022] GET /identity/v3/users/f007d4bc3b07479e97c540f22c181ce9 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:49.673782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0e140-cf74-4013-a89d-f1937fe51971 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.674068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0e140-cf74-4013-a89d-f1937fe51971 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.674352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0e140-cf74-4013-a89d-f1937fe51971 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.676020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 109/225] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:49.681967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0e140-cf74-4013-a89d-f1937fe51971 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:49.777517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19dc12-c3f7-43fa-a73c-11f12b385efb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:49.809394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0e140-cf74-4013-a89d-f1937fe51971 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:49.822083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:49.826954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc7abb-5873-421d-9e1a-b09360366b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:49.831217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc7abb-5873-421d-9e1a-b09360366b3f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.831217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc7abb-5873-421d-9e1a-b09360366b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.831217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc7abb-5873-421d-9e1a-b09360366b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.831217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc7abb-5873-421d-9e1a-b09360366b3f None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=e3ba1cb473cf45a3895a198919887e59) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:49.831217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc7abb-5873-421d-9e1a-b09360366b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:49.832367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc7abb-5873-421d-9e1a-b09360366b3f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:49.841958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 117/226] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:49 2022] GET /identity/v3/role_assignments?user.id=e3ba1cb473cf45a3895a198919887e59&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:49.844291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690f0d9-5b93-42e9-aa1e-833db1df188c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.844829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690f0d9-5b93-42e9-aa1e-833db1df188c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.845308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690f0d9-5b93-42e9-aa1e-833db1df188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.847607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:49.848480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:49.848866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:49.849508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:49.851397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:49.853113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:49.855095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 110/227] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:49 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:49.869309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:49.950347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4690f0d9-5b93-42e9-aa1e-833db1df188c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:49.952560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4690f0d9-5b93-42e9-aa1e-833db1df188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:50.076375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8b3eb-3a40-4dfc-a919-0f3ee4185ebd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:50.084724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 118/228] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:50.108820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690f0d9-5b93-42e9-aa1e-833db1df188c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:50.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:50.136847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:50.138340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.139957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.140638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa/users/f007d4bc3b07479e97c540f22c181ce9/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.149254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] RBAC: Authorizing `identity:create_grant(project_id=2f16b03fffc5439dabda794010e988aa, user_id=f007d4bc3b07479e97c540f22c181ce9, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:50.158864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:50.163859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:50.258382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 111/229] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:49 2022] PUT /identity/v3/projects/2f16b03fffc5439dabda794010e988aa/users/f007d4bc3b07479e97c540f22c181ce9/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:02:50.284476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690f0d9-5b93-42e9-aa1e-833db1df188c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:50.332924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:50.334022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.334759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.336302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.362201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:50.367809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:50.368868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:50.369669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:50.371764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 119/230] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:50.377671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:50.515641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1eb70-c32c-4b51-b86d-4437a546075c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:50.570393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:50.571324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.572303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.572781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.573678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:50.574249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:50.575818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:50.589956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 112/231] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:02:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:50.595329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:50.685976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:50.737350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118966-b4ef-496a-9d71-0b31dedd7946 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:50.779323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:50.779978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.780259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.780537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] PATH_INFO: `/v3/users/f007d4bc3b07479e97c540f22c181ce9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.781757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=f007d4bc3b07479e97c540f22c181ce9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:50.783209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:50.784823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 120/232] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:50 2022] GET /identity/v3/users/f007d4bc3b07479e97c540f22c181ce9 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:50.790952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:50.878682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:50.925118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a419-60c0-485a-a339-5fadc29c26b6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:50.975578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf412ca-dc32-45e4-812b-902edc664a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:50.976243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf412ca-dc32-45e4-812b-902edc664a9b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:50.976525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf412ca-dc32-45e4-812b-902edc664a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:50.976799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf412ca-dc32-45e4-812b-902edc664a9b None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:50.978712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf412ca-dc32-45e4-812b-902edc664a9b None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:50.980317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf412ca-dc32-45e4-812b-902edc664a9b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:50.982382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 113/233] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:50 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:50.988272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:51.150718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d424d-bb49-45e7-bddb-d96106b7e1b6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:51.194731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:51.205210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f57f0d-14e4-49ef-b968-5533d05a024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:51.205921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f57f0d-14e4-49ef-b968-5533d05a024f None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.206207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f57f0d-14e4-49ef-b968-5533d05a024f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.206490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f57f0d-14e4-49ef-b968-5533d05a024f None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa/users/f007d4bc3b07479e97c540f22c181ce9/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.208732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f57f0d-14e4-49ef-b968-5533d05a024f None admin] RBAC: Authorizing `identity:create_grant(project_id=2f16b03fffc5439dabda794010e988aa, user_id=f007d4bc3b07479e97c540f22c181ce9, role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:51.210419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f57f0d-14e4-49ef-b968-5533d05a024f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:51.353244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 121/234] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:50 2022] PUT /identity/v3/projects/2f16b03fffc5439dabda794010e988aa/users/f007d4bc3b07479e97c540f22c181ce9/roles/db362c02a23549c9815e38259950ff5c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:51.476884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0976-25e9-4481-b8f2-f8de9334abd4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.478485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0976-25e9-4481-b8f2-f8de9334abd4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.478966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0976-25e9-4481-b8f2-f8de9334abd4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.480549 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 114/235] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:51.486216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cd951-f689-46d7-9bbb-0c775981f280 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.486770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cd951-f689-46d7-9bbb-0c775981f280 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.487266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cd951-f689-46d7-9bbb-0c775981f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.508081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a95cd951-f689-46d7-9bbb-0c775981f280 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:51.510382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a95cd951-f689-46d7-9bbb-0c775981f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:51.598240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01542c4f-2586-4d3f-a7e3-2f070dda854a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.598556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01542c4f-2586-4d3f-a7e3-2f070dda854a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.598857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01542c4f-2586-4d3f-a7e3-2f070dda854a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.600852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 115/236] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:51.604900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 122/237] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:51.606603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877c2e0-8884-4707-ac55-2ada19e26598 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.606897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877c2e0-8884-4707-ac55-2ada19e26598 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.607178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877c2e0-8884-4707-ac55-2ada19e26598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.633803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cd951-f689-46d7-9bbb-0c775981f280 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:51.638805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a877c2e0-8884-4707-ac55-2ada19e26598 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:51.643128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a877c2e0-8884-4707-ac55-2ada19e26598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:51.724115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 116/238] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:51.748236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877c2e0-8884-4707-ac55-2ada19e26598 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:51.763227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cd951-f689-46d7-9bbb-0c775981f280 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:51.784035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:51.811328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:51.812047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.812331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.812605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.814827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:51.816285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:51.817920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 123/239] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:51.822217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:51.828719 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:51.901119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877c2e0-8884-4707-ac55-2ada19e26598 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:51.968241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:51.969350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:51.969868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:51.970407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:51.992597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1b6e-bd96-4571-a28f-0d4e8237a2df None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:51.997788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:52.003703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:52.004636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:52.005432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:52.016181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 117/240] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:52.021433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:52.031459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:52.032081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.032362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.032636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.033321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:52.034795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:52.115258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 124/241] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:02:51 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:52.165389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49fe24-c2e2-496f-a4ae-953c9e17157b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:52.184907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.204359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:52.205023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.205375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.205658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.206435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:52.206738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:52.208166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:52.224887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 118/242] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:52.230609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:52.286848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.346953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc813-6b38-4a8f-900b-2c043d6d83fc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:52.388022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd180d1-d376-4df5-8d9b-162058726f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:52.388771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd180d1-d376-4df5-8d9b-162058726f9b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.388952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd180d1-d376-4df5-8d9b-162058726f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.389235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd180d1-d376-4df5-8d9b-162058726f9b None admin] PATH_INFO: `/v3/users/82b09aebfd20486e89451cefdbd45fc3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.405026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd180d1-d376-4df5-8d9b-162058726f9b None admin] RBAC: Authorizing `identity:get_user(user_id=82b09aebfd20486e89451cefdbd45fc3)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:52.406543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd180d1-d376-4df5-8d9b-162058726f9b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:52.408308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 125/243] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/users/82b09aebfd20486e89451cefdbd45fc3 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:52.413876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:52.529966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bc7e-6f9f-421d-a8a5-434d36562d03 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:52.558657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d49d-dd79-462b-a4b7-466fd095e6ff None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.558842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d49d-dd79-462b-a4b7-466fd095e6ff None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.559126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d49d-dd79-462b-a4b7-466fd095e6ff None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.560680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 126/244] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:02:52.565823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df029f-d685-438b-a764-cd799afe2b2e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.566111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df029f-d685-438b-a764-cd799afe2b2e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.566393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df029f-d685-438b-a764-cd799afe2b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.575844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:52.576804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.577276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.577773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.586724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d5df029f-d685-438b-a764-cd799afe2b2e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:52.588028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d5df029f-d685-438b-a764-cd799afe2b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:52.639275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.668417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:52.670214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:52.696141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 127/245] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:52.727447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df029f-d685-438b-a764-cd799afe2b2e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:52.771288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.810645 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 119/246] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:52.816018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:52.859161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df029f-d685-438b-a764-cd799afe2b2e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:52.898370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:52.899081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.899363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.900349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.905457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:52.913055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:52.919128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:52.920911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:52.921995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 128/247] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:52.926678 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:52.930618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2cb1c-c923-46b2-9bfd-6c285b3b9dc4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:52.969673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:52.970366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:52.970650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:52.970932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:52.972142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:52.973750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:52.975727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 120/248] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:52.982206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:53.040659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:53.051373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968c1d-4a38-440f-b2b9-3c688d709fb4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:53.092501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40efc52-68ea-45cc-b536-76f5d751d256 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:53.095549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5342e0-55ba-49d0-b3bf-54f504e70975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:53.096179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5342e0-55ba-49d0-b3bf-54f504e70975 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:53.096461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5342e0-55ba-49d0-b3bf-54f504e70975 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:53.096737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5342e0-55ba-49d0-b3bf-54f504e70975 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:53.097471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5342e0-55ba-49d0-b3bf-54f504e70975 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:53.097805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5342e0-55ba-49d0-b3bf-54f504e70975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:53.099447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5342e0-55ba-49d0-b3bf-54f504e70975 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:53.109833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 129/249] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:53.111210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743066-08ea-428f-a649-da8d19c9994e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:53.111504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743066-08ea-428f-a649-da8d19c9994e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:53.111782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743066-08ea-428f-a649-da8d19c9994e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:53.113094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 130/250] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:53.117883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743066-08ea-428f-a649-da8d19c9994e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:53.189750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0e6c-5067-4440-b261-9336e5112d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:53.189750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0e6c-5067-4440-b261-9336e5112d58 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:53.189750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0e6c-5067-4440-b261-9336e5112d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:53.189750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0e6c-5067-4440-b261-9336e5112d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:53.190153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b0e6c-5067-4440-b261-9336e5112d58 None admin] RBAC: Adding query filter params (role.id=ac2d9625feb9489d874dbb22baa40e23, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=82b09aebfd20486e89451cefdbd45fc3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:53.190153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b0e6c-5067-4440-b261-9336e5112d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:53.190153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b0e6c-5067-4440-b261-9336e5112d58 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:53.209743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 121/251] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:52 2022] GET /identity/v3/role_assignments?user.id=82b09aebfd20486e89451cefdbd45fc3&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=ac2d9625feb9489d874dbb22baa40e23 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:53.209743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c90a0-852a-4584-bb39-febc7fe8d32b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:53.209743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c90a0-852a-4584-bb39-febc7fe8d32b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:53.209743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c90a0-852a-4584-bb39-febc7fe8d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:53.253749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bc3c90a0-852a-4584-bb39-febc7fe8d32b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:53.253749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc3c90a0-852a-4584-bb39-febc7fe8d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:53.260767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:53.348147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743066-08ea-428f-a649-da8d19c9994e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:53.435551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:53.436445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:53.436614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:53.436864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] PATH_INFO: `/v3/users/e3ba1cb473cf45a3895a198919887e59` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:53.441746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ba1cb473cf45a3895a198919887e59)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:53.441746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:53.451760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 131/252] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:53 2022] GET /identity/v3/users/e3ba1cb473cf45a3895a198919887e59 => generated 297 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:53.457381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:53.530209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 122/253] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:53.539450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:53.570745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c90a0-852a-4584-bb39-febc7fe8d32b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:53.735727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f696667-a972-4e1c-b36d-89fd16fe57f2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:53.818637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c90a0-852a-4584-bb39-febc7fe8d32b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:53.825890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:53.826555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:53.826840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:53.827119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:53.829653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:53.834729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:53.837902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 132/254] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:53 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:53.848061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:53.918453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:53.919125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:53.919407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:53.919684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:53.942817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:53.950665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:53.955684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:53.964969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 123/255] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:53.965786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:54.015816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:54.026104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3910f-a9cf-4239-8a85-9fb26594dff2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:54.076358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:54.077042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.077327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.077603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa/users/e3ba1cb473cf45a3895a198919887e59/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.081987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] RBAC: Authorizing `identity:create_grant(project_id=2f16b03fffc5439dabda794010e988aa, user_id=e3ba1cb473cf45a3895a198919887e59, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:54.083445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:54.166672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 133/256] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:53 2022] PUT /identity/v3/projects/2f16b03fffc5439dabda794010e988aa/users/e3ba1cb473cf45a3895a198919887e59/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:54.169444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13fadc-7fdc-4d27-9150-34561e30927d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:54.208249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f051b-950b-4923-9b97-7468b51ef810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:54.208949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f051b-950b-4923-9b97-7468b51ef810 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.209240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f051b-950b-4923-9b97-7468b51ef810 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.209565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f051b-950b-4923-9b97-7468b51ef810 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.210422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f051b-950b-4923-9b97-7468b51ef810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:54.210734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f051b-950b-4923-9b97-7468b51ef810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:54.212304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f051b-950b-4923-9b97-7468b51ef810 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:54.221964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 124/257] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:54.228735 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:54.352189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4fa39-8294-4df6-a70b-63d22bc5364f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:54.380672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254459-6ed2-4560-8898-23c31d724108 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.381012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254459-6ed2-4560-8898-23c31d724108 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.381237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254459-6ed2-4560-8898-23c31d724108 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.382933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 125/258] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:54.388798 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059639-1022-47f5-85fb-dcad04978096 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.389106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059639-1022-47f5-85fb-dcad04978096 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.389585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059639-1022-47f5-85fb-dcad04978096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.412572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:54.413159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2d059639-1022-47f5-85fb-dcad04978096 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:54.413299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.413583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.413903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] PATH_INFO: `/v3/users/f007d4bc3b07479e97c540f22c181ce9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.414409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2d059639-1022-47f5-85fb-dcad04978096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:54.416188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] RBAC: Authorizing `identity:get_user(user_id=f007d4bc3b07479e97c540f22c181ce9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:54.417746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:54.419803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 134/259] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:54 2022] GET /identity/v3/users/f007d4bc3b07479e97c540f22c181ce9 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:54.425183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:54.459288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:54.491161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:54.518192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 126/260] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:54.589911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059639-1022-47f5-85fb-dcad04978096 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:54.591003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9523e15-9638-4347-9730-c507cce6ece9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:54.694428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:54.695458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.695968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.697010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.740344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059639-1022-47f5-85fb-dcad04978096 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:54.815021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:54.815928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:54.816355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:54.816858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:54.851642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:54.857533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:54.858505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:02:54.859293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:54.865063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:54.867077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 127/261] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:02:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:54.873614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:54.874040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:54.900397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:54.942328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:55.038747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8e75c-4829-42a9-bae6-a708f7fb9aef None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:55.064993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 135/262] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:55.070110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:55.095822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:55.096625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.096977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.097472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.098452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:55.098830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:55.100843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:55.112639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 128/263] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:02:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:55.120090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:55.277415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a0a15-ce02-49d8-93b7-6f20451b8b41 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:55.292156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40941e7-f253-49d3-8f70-b75d27c25e3d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:55.293501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:55.333085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:55.334033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.334327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.334615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] PATH_INFO: `/v3/users/f007d4bc3b07479e97c540f22c181ce9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.339152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:55.339604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] RBAC: Authorizing `identity:get_user(user_id=f007d4bc3b07479e97c540f22c181ce9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:55.341106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:55.343321 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 129/264] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:55 2022] GET /identity/v3/users/f007d4bc3b07479e97c540f22c181ce9 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:55.352055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:55.383325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:55.384063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.384371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.384621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.390471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:55.391956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:55.393678 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 136/265] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:55 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:55.404740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:55.528952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b6542-c162-44d7-81a1-22e568631dca None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:55.589968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddfd59-b209-46e4-98c0-ac6d9deb1b2f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:55.591354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:55.592511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.592859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.593204 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.630560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac492b36-a369-4cd8-ac7b-6dbce457bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:55.631879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492b36-a369-4cd8-ac7b-6dbce457bf61 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.632387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492b36-a369-4cd8-ac7b-6dbce457bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.632857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492b36-a369-4cd8-ac7b-6dbce457bf61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.634451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac492b36-a369-4cd8-ac7b-6dbce457bf61 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=f007d4bc3b07479e97c540f22c181ce9) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:55.635022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac492b36-a369-4cd8-ac7b-6dbce457bf61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:55.636655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac492b36-a369-4cd8-ac7b-6dbce457bf61 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:55.644647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 137/266] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:55 2022] GET /identity/v3/role_assignments?user.id=f007d4bc3b07479e97c540f22c181ce9&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:55.646502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd4fd-2626-4e0b-bb25-e976792b6368 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.646992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd4fd-2626-4e0b-bb25-e976792b6368 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.647464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd4fd-2626-4e0b-bb25-e976792b6368 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.649081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 138/267] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:55.655908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae79b65-ecae-4cf8-a7f8-878240354400 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.656983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae79b65-ecae-4cf8-a7f8-878240354400 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.657509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae79b65-ecae-4cf8-a7f8-878240354400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.689859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3ae79b65-ecae-4cf8-a7f8-878240354400 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:55.691125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3ae79b65-ecae-4cf8-a7f8-878240354400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:55.695095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:55.717114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:55.719042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:55.783690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:55.828903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 139/268] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:55.830715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880212-a1ad-4fd5-8bda-87c829961521 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.831216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880212-a1ad-4fd5-8bda-87c829961521 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.831719 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880212-a1ad-4fd5-8bda-87c829961521 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.833222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 140/269] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:55.839632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9ac7-a528-4882-9fe9-3f47792fe8a0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:55.840360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9ac7-a528-4882-9fe9-3f47792fe8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:55.840855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9ac7-a528-4882-9fe9-3f47792fe8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:55.844465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 130/270] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:55.850268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:55.873965 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a21b9ac7-a528-4882-9fe9-3f47792fe8a0 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:55.875393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a21b9ac7-a528-4882-9fe9-3f47792fe8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:55.943536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:55.959083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 141/271] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:55.963719 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9ac7-a528-4882-9fe9-3f47792fe8a0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:55.964390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0fcca-2236-4e98-875a-fe899b37abef None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.004644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.005446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.005747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.006027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.010675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:56.012417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:56.014492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 131/272] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:55 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:56.015535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.125300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9ac7-a528-4882-9fe9-3f47792fe8a0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.134987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22960bca-64d3-4285-8209-13a5f28e4480 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.140167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:56.168478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.169395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.169845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.170260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.180829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.181854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.182247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.182754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.186354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:56.186564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:56.188140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:56.193750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 132/273] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:56.193750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:56.196067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:56.197511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:56.198343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:56.201421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 142/274] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:56.201539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.228232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:56.317875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522795bd-cb19-4da2-8eb8-4e84d1855ec2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.333674 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0add-d507-41a8-a621-a7f5bdd3b8d3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.355873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.357119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.357608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.358149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.359195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] RBAC: Adding query filter params (role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=f007d4bc3b07479e97c540f22c181ce9) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:56.359765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:56.361529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:56.368262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 133/275] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:56 2022] GET /identity/v3/role_assignments?user.id=f007d4bc3b07479e97c540f22c181ce9&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=db362c02a23549c9815e38259950ff5c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:56.369801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.385772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d007829-bf3b-4a5c-a7d1-f31dd0443ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.386784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d007829-bf3b-4a5c-a7d1-f31dd0443ae5 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.387710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d007829-bf3b-4a5c-a7d1-f31dd0443ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.388188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d007829-bf3b-4a5c-a7d1-f31dd0443ae5 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.390469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d007829-bf3b-4a5c-a7d1-f31dd0443ae5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:56.394233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d007829-bf3b-4a5c-a7d1-f31dd0443ae5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:56.490315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:56.516036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b1b19-250c-4ac2-a765-496f43c379bd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.519029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 143/276] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:02:56 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:56.520827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec1a6-4b4e-409a-9760-fa1f34750074 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.521330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec1a6-4b4e-409a-9760-fa1f34750074 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.522168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec1a6-4b4e-409a-9760-fa1f34750074 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.524250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 144/277] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:56.532089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd60877-9481-4056-b3de-9f47947c5c02 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.532808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd60877-9481-4056-b3de-9f47947c5c02 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.533291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd60877-9481-4056-b3de-9f47947c5c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.560677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8cd60877-9481-4056-b3de-9f47947c5c02 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:56.562419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8cd60877-9481-4056-b3de-9f47947c5c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:56.591712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:56.593216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.593760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.594564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.594564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.595061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:56.595370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:56.596797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:56.609231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 134/278] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:56.615012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.662091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 145/279] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:56.690773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd60877-9481-4056-b3de-9f47947c5c02 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.735286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80c2c-551e-4905-a4e5-6081eccd3ce5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.779695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ee89f-041c-4264-b735-0791891d323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.780352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ee89f-041c-4264-b735-0791891d323e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.780635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ee89f-041c-4264-b735-0791891d323e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.780949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ee89f-041c-4264-b735-0791891d323e None admin] PATH_INFO: `/v3/users/cd8e47f421134e148520f186b5a2d767` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.797267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ee89f-041c-4264-b735-0791891d323e None admin] RBAC: Authorizing `identity:get_user(user_id=cd8e47f421134e148520f186b5a2d767)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:56.798899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ee89f-041c-4264-b735-0791891d323e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:56.800610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 135/280] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:56 2022] GET /identity/v3/users/cd8e47f421134e148520f186b5a2d767 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:56.808354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ee89f-041c-4264-b735-0791891d323e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.812950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:56.819879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd60877-9481-4056-b3de-9f47947c5c02 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.862921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.863873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.864339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.864821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:56.881612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:56.887395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:56.888282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:56.889220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 146/281] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:02:56.896676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:56.922241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:56.953840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ee89f-041c-4264-b735-0791891d323e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:56.998692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:56.999329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:56.999612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:56.999890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.000722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, user.id=cd8e47f421134e148520f186b5a2d767, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:57.001038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:57.002604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:57.008615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 136/282] 10.222.0.71 () {56 vars in 1308 bytes} [Tue Aug 2 09:02:56 2022] GET /identity/v3/role_assignments?user.id=cd8e47f421134e148520f186b5a2d767&scope.system=all&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:57.042163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ca78-4d35-44ad-9c80-d7e1e1a7d961 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:57.084853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12994466-36d3-4335-9085-70e4f2ae4e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:57.085837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994466-36d3-4335-9085-70e4f2ae4e0e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.086341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994466-36d3-4335-9085-70e4f2ae4e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.086819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994466-36d3-4335-9085-70e4f2ae4e0e None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.087910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12994466-36d3-4335-9085-70e4f2ae4e0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:57.088454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12994466-36d3-4335-9085-70e4f2ae4e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:57.090085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12994466-36d3-4335-9085-70e4f2ae4e0e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:57.101461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 147/283] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:57.108647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:57.161184 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2835d5-85a6-4123-bba7-705909b9d3a9 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.161799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2835d5-85a6-4123-bba7-705909b9d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.162763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2835d5-85a6-4123-bba7-705909b9d3a9 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.165639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 148/284] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:57.172498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614e15-51c4-41dd-8069-26f876da9b4f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.172756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614e15-51c4-41dd-8069-26f876da9b4f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.172974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614e15-51c4-41dd-8069-26f876da9b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.193701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:57.214830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ba614e15-51c4-41dd-8069-26f876da9b4f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:57.216045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ba614e15-51c4-41dd-8069-26f876da9b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:57.235038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0c814-fa69-48c7-9fa9-58e57a5329e0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:57.276908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:57.278145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.278665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.279177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] PATH_INFO: `/v3/users/82b09aebfd20486e89451cefdbd45fc3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.280661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] RBAC: Authorizing `identity:get_user(user_id=82b09aebfd20486e89451cefdbd45fc3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:57.282468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:57.285626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 137/285] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:57 2022] GET /identity/v3/users/82b09aebfd20486e89451cefdbd45fc3 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:57.293072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:57.298345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 149/286] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:02:57.333257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba614e15-51c4-41dd-8069-26f876da9b4f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:57.356255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:57.408399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5c54-52cc-4678-a997-f8c68e47c0af None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:57.450107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:57.450107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.450107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.450107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.450480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:57.450480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:57.451738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 138/287] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:57 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:57.460971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:57.472174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:57.512407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba614e15-51c4-41dd-8069-26f876da9b4f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:57.579220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:57.579872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.580161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.580440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.606666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:57.611781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:57.612684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:02:57.613928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 150/288] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:57.622716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:57.639689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af29dff-b938-4871-abd3-10ed68e0e672 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:57.683965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:57.684665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.684987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.685297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa/users/82b09aebfd20486e89451cefdbd45fc3/roles/ac2d9625feb9489d874dbb22baa40e23` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.691934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f16b03fffc5439dabda794010e988aa, user_id=82b09aebfd20486e89451cefdbd45fc3, role_id=ac2d9625feb9489d874dbb22baa40e23)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:57.693409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:57.740460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:57.779143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0477-3144-4f06-bef3-df6a79be6d5c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:57.806287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 139/289] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:02:57 2022] PUT /identity/v3/projects/2f16b03fffc5439dabda794010e988aa/users/82b09aebfd20486e89451cefdbd45fc3/roles/ac2d9625feb9489d874dbb22baa40e23 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:02:57.829627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:57.830360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:57.830652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:57.830933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:57.831668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:57.831977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:57.833365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:57.843685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 151/290] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:57.849601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:57.979637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:58.035518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124491-7c44-4a24-bd3d-71f2d3557919 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:58.082844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:58.083508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:58.083833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:58.084132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] PATH_INFO: `/v3/users/e3ba1cb473cf45a3895a198919887e59` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:58.086444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] RBAC: Authorizing `identity:get_user(user_id=e3ba1cb473cf45a3895a198919887e59)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:58.088469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:58.090193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 140/291] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:57 2022] GET /identity/v3/users/e3ba1cb473cf45a3895a198919887e59 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:58.096253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:58.231880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c41b4-e51a-4d63-842a-bc0dce059019 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:58.271841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:58.277622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:58.278277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:58.278561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:58.278842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:58.358908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:58.360329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:58.473185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 152/292] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:58.479876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:58.606603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd505ae-9fc9-48f6-bf6f-66d2be1bfeea None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:58.637639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:58.644019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44e8f-9e37-4e70-a7a0-2ebc7452cb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:58.644667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44e8f-9e37-4e70-a7a0-2ebc7452cb1f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:58.645007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44e8f-9e37-4e70-a7a0-2ebc7452cb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:58.645352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44e8f-9e37-4e70-a7a0-2ebc7452cb1f None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:58.646650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44e8f-9e37-4e70-a7a0-2ebc7452cb1f None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:58.648105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44e8f-9e37-4e70-a7a0-2ebc7452cb1f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:58.650088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 141/293] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:02:58 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:58.656903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:58.688240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:58.762367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dc0a-f6b8-4b5b-acfa-51074140cb8c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:58.815550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034def26-65bf-4d50-8544-2abab1d4d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:58.816172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034def26-65bf-4d50-8544-2abab1d4d39c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:58.816517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034def26-65bf-4d50-8544-2abab1d4d39c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:58.816794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034def26-65bf-4d50-8544-2abab1d4d39c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:58.817640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034def26-65bf-4d50-8544-2abab1d4d39c None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=e3ba1cb473cf45a3895a198919887e59) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:58.817984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034def26-65bf-4d50-8544-2abab1d4d39c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:58.819469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034def26-65bf-4d50-8544-2abab1d4d39c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:58.830446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 153/294] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:02:58 2022] GET /identity/v3/role_assignments?user.id=e3ba1cb473cf45a3895a198919887e59&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:59.160896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a678e-15ec-4d1b-bf91-993c1a80c45d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.161175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a678e-15ec-4d1b-bf91-993c1a80c45d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.161464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a678e-15ec-4d1b-bf91-993c1a80c45d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.163167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 142/295] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:59.168406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bead07-ad6c-427e-85cd-1ee780806e4f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.168930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bead07-ad6c-427e-85cd-1ee780806e4f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.169407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bead07-ad6c-427e-85cd-1ee780806e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.189387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e0bead07-ad6c-427e-85cd-1ee780806e4f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:59.191033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e0bead07-ad6c-427e-85cd-1ee780806e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:59.264708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 154/296] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:59.288836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a678e-15ec-4d1b-bf91-993c1a80c45d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:59.369686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5987c-d728-45b8-8e0f-40c261a7d01a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.370351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5987c-d728-45b8-8e0f-40c261a7d01a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.370829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5987c-d728-45b8-8e0f-40c261a7d01a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.372733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 155/297] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:59.378822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032172c5-de7f-48dc-8675-12bcd8c33d2f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.379369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032172c5-de7f-48dc-8675-12bcd8c33d2f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.379847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032172c5-de7f-48dc-8675-12bcd8c33d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.405161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-032172c5-de7f-48dc-8675-12bcd8c33d2f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:59.406904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-032172c5-de7f-48dc-8675-12bcd8c33d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:02:59.412161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a678e-15ec-4d1b-bf91-993c1a80c45d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:59.437664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:59.460677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:59.462229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.463422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.463422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.476632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:02:59.485039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:02:59.485977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:02:59.486769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 143/298] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:02:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:02:59.493056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:59.510243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 156/299] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:02:59.531828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032172c5-de7f-48dc-8675-12bcd8c33d2f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:59.572138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:59.633332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ef86-b76b-4b9a-9999-66f2bf642516 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:59.643939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032172c5-de7f-48dc-8675-12bcd8c33d2f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:59.672753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:59.674254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.674715 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.675189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.676085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:02:59.676663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:59.678385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:59.683097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:59.683813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.684164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.684510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.685787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:59.687290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:59.689016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 157/300] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:02:59.690553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 144/301] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:02:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:59.695159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:59.696423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:59.720486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:59.802232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6ab1-8e0b-45b1-8f06-072ea9c90066 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:59.807291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4532d-de00-4e07-9ac5-a59d1300fefa None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:02:59.829476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:59.839858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77d51f-9840-4061-8da0-b3101637772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:59.840393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77d51f-9840-4061-8da0-b3101637772c None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.840887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77d51f-9840-4061-8da0-b3101637772c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.841004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77d51f-9840-4061-8da0-b3101637772c None admin] PATH_INFO: `/v3/groups` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.841615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77d51f-9840-4061-8da0-b3101637772c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:59.843172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77d51f-9840-4061-8da0-b3101637772c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:59.848261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689de5be-8c64-45df-88f3-56937bfdf273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:02:59.848904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de5be-8c64-45df-88f3-56937bfdf273 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.849430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de5be-8c64-45df-88f3-56937bfdf273 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.849807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de5be-8c64-45df-88f3-56937bfdf273 None admin] PATH_INFO: `/v3/users/15f3a1e7415a464795ffbe1c607dac8a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.864932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689de5be-8c64-45df-88f3-56937bfdf273 None admin] RBAC: Authorizing `identity:get_user(user_id=15f3a1e7415a464795ffbe1c607dac8a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:02:59.866462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689de5be-8c64-45df-88f3-56937bfdf273 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:02:59.868194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 145/302] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:02:59 2022] GET /identity/v3/users/15f3a1e7415a464795ffbe1c607dac8a => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:02:59.869378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ba92-f372-4c5d-b684-1e23ed590194 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.869672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ba92-f372-4c5d-b684-1e23ed590194 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.869955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ba92-f372-4c5d-b684-1e23ed590194 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.871330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 146/303] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:02:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:02:59.874688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ba92-f372-4c5d-b684-1e23ed590194 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:02:59.918407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 158/304] 10.222.0.71 () {60 vars in 1134 bytes} [Tue Aug 2 09:02:59 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:02:59.919646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0de7-29da-4c82-95f4-74c32c753817 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:02:59.919969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0de7-29da-4c82-95f4-74c32c753817 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:02:59.920311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0de7-29da-4c82-95f4-74c32c753817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:02:59.939892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ed4e0de7-29da-4c82-95f4-74c32c753817 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:02:59.941072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ed4e0de7-29da-4c82-95f4-74c32c753817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:00.023161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 159/305] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:00.046943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e0de7-29da-4c82-95f4-74c32c753817 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.064181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.068704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ba92-f372-4c5d-b684-1e23ed590194 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.122575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.123266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.123546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.124123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.125451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] RBAC: Adding query filter params (role.id=ac2d9625feb9489d874dbb22baa40e23, user.id=15f3a1e7415a464795ffbe1c607dac8a, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:00.125806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:00.127633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:00.135418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 147/306] 10.222.0.71 () {56 vars in 1308 bytes} [Tue Aug 2 09:02:59 2022] GET /identity/v3/role_assignments?user.id=15f3a1e7415a464795ffbe1c607dac8a&scope.system=all&role.id=ac2d9625feb9489d874dbb22baa40e23 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:00.183761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e0de7-29da-4c82-95f4-74c32c753817 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.225910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d1471-ad39-45c6-966b-e87a594d1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.226958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1471-ad39-45c6-966b-e87a594d1f0a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.227997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1471-ad39-45c6-966b-e87a594d1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.228488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1471-ad39-45c6-966b-e87a594d1f0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.241561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d1471-ad39-45c6-966b-e87a594d1f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-bb9d1471-ad39-45c6-966b-e87a594d1f0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:00.247508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:00.248464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:00.249268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:00.251493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 160/307] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:00.260825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.268609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178865-d62d-4eab-8704-a96c5fc582ce None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.268906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178865-d62d-4eab-8704-a96c5fc582ce None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.269194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178865-d62d-4eab-8704-a96c5fc582ce None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.274019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 161/308] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:00.277040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96728-b37b-4b2f-8930-4f6935c84ac0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.277040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96728-b37b-4b2f-8930-4f6935c84ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.277266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96728-b37b-4b2f-8930-4f6935c84ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.296440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-eea96728-b37b-4b2f-8930-4f6935c84ac0 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:00.297687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eea96728-b37b-4b2f-8930-4f6935c84ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:00.311101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.373418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb252f09-3944-4280-a18d-5612bb5dbb5f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.376107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 162/309] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:00.403408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96728-b37b-4b2f-8930-4f6935c84ac0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.405937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.419982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.420837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.421266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.421682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.425226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:00.425226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:00.425226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:00.434566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 148/310] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:00.440315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.534506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96728-b37b-4b2f-8930-4f6935c84ac0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.554819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071648-6117-48d1-9f41-5fedee87891d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.557912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.573634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.574584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.576104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.576104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.586523 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:00.590458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.591109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.591394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.591672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] PATH_INFO: `/v3/users/cd8e47f421134e148520f186b5a2d767` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:00.592765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:00.593840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:03:00.594773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:00.595374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] RBAC: Authorizing `identity:get_user(user_id=cd8e47f421134e148520f186b5a2d767)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:00.595374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:00.596033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 149/311] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/users/cd8e47f421134e148520f186b5a2d767 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:00.596885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 163/312] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:00.603089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.603758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.679522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.713585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ee7d-0413-487f-877b-0877d1cff921 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.726642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0403-2a9d-43b9-9d8b-af29b7c751a4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.750511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.751431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.751858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.752788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] PATH_INFO: `/v3/system/users/cd8e47f421134e148520f186b5a2d767/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.754799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cd8e47f421134e148520f186b5a2d767, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:00.757050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:00.770755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.771656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.772080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.772508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.773479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:00.773954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:00.776286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:00.785132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 164/313] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:00.791832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:00.845208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 150/314] 10.222.0.71 () {58 vars in 1334 bytes} [Tue Aug 2 09:03:00 2022] PUT /identity/v3/system/users/cd8e47f421134e148520f186b5a2d767/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:00.916907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08687-d9fc-4ac3-8ea5-b0b68de0b2e3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:00.944186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:00.957391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:00.958156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:00.958500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:00.962396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] PATH_INFO: `/v3/users/82b09aebfd20486e89451cefdbd45fc3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:00.962396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] RBAC: Authorizing `identity:get_user(user_id=82b09aebfd20486e89451cefdbd45fc3)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:00.962396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:00.964923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 165/315] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/users/82b09aebfd20486e89451cefdbd45fc3 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:00.970396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:01.012533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:01.081784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81855728-d40f-4d32-b14b-af45c81beeae None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:01.117329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:01.118679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:01.118878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:01.119165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:01.194827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:01.197421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:01.235264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:01.309548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 151/316] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:01.315549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:01.425397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91037-185d-4f76-9c4d-c36cee410a30 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:01.464946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a413-c19c-4abd-88ab-421a63090feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:01.465832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a413-c19c-4abd-88ab-421a63090feb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:01.466231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a413-c19c-4abd-88ab-421a63090feb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:01.466643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a413-c19c-4abd-88ab-421a63090feb None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:01.467917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1a413-c19c-4abd-88ab-421a63090feb None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:01.469458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1a413-c19c-4abd-88ab-421a63090feb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:01.471623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 166/317] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:01 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:01.478878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:01.588742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae345fb-8f18-449f-b005-c1051c7f58d0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:01.627400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809669d-7431-4755-a6f4-d22307c9eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:01.628261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809669d-7431-4755-a6f4-d22307c9eb9d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:01.628704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809669d-7431-4755-a6f4-d22307c9eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:01.629119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809669d-7431-4755-a6f4-d22307c9eb9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:01.630164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809669d-7431-4755-a6f4-d22307c9eb9d None admin] RBAC: Adding query filter params (role.id=ac2d9625feb9489d874dbb22baa40e23, scope.project.id=2f16b03fffc5439dabda794010e988aa, user.id=82b09aebfd20486e89451cefdbd45fc3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:01.630617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809669d-7431-4755-a6f4-d22307c9eb9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:01.632296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809669d-7431-4755-a6f4-d22307c9eb9d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:01.636423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:01.640786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 152/318] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:01 2022] GET /identity/v3/role_assignments?user.id=82b09aebfd20486e89451cefdbd45fc3&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=ac2d9625feb9489d874dbb22baa40e23 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:02.047882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de50b17-a9aa-46ce-b29a-5a468744d118 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.048389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de50b17-a9aa-46ce-b29a-5a468744d118 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.048659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de50b17-a9aa-46ce-b29a-5a468744d118 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.050134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 167/319] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:02.055047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac173-5509-49d8-909c-927137e29788 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.055979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac173-5509-49d8-909c-927137e29788 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.056155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac173-5509-49d8-909c-927137e29788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.076501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-303ac173-5509-49d8-909c-927137e29788 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:02.077738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-303ac173-5509-49d8-909c-927137e29788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:02.149849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 153/320] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:02.171159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de50b17-a9aa-46ce-b29a-5a468744d118 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:02.234496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:02.239471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0930bf-62e9-4d3c-95e7-7f6bbbb62117 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.239813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0930bf-62e9-4d3c-95e7-7f6bbbb62117 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.240094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0930bf-62e9-4d3c-95e7-7f6bbbb62117 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.241569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 154/321] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:02.246978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6b70-539a-4118-bdea-9bc9bb4a79cf None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.247263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6b70-539a-4118-bdea-9bc9bb4a79cf None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.247535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6b70-539a-4118-bdea-9bc9bb4a79cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.266007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-389c6b70-539a-4118-bdea-9bc9bb4a79cf None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:02.267212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-389c6b70-539a-4118-bdea-9bc9bb4a79cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:02.280293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de50b17-a9aa-46ce-b29a-5a468744d118 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:02.324953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:02.325590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.325948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.326231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.327290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:02.328718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:02.330624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 168/322] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:02.335745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:02.340271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 155/323] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:02.362894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c6b70-539a-4118-bdea-9bc9bb4a79cf None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:02.425427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:02.447130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba24d-b795-44b3-8478-0e90e11e2947 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:02.470646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c6b70-539a-4118-bdea-9bc9bb4a79cf None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:02.478513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:02.486243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:02.490476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.490476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.490476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] PATH_INFO: `/v3/groups` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.490476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:02.490476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:02.507101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:02.507766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.508047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.508318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.518454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:02.523413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:02.524988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:02.525924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 156/324] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:02.530835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:02.591540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 169/325] 10.222.0.71 () {60 vars in 1134 bytes} [Tue Aug 2 09:03:02 2022] POST /identity/v3/groups => generated 226 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:03:02.648406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e516b-45c4-47ec-be4e-8f72d3a322b9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:02.671541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:02.688965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:02.689591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.690132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.690479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.691290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:02.691722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:02.693230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:02.706082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 157/326] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:02.708856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:02.815647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba010a9-bfc6-46f4-b55d-8b20dd039300 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:02.853078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9775e-7e22-4b00-aeb2-cfb9f05f5dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:02.854004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9775e-7e22-4b00-aeb2-cfb9f05f5dbf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:02.854389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9775e-7e22-4b00-aeb2-cfb9f05f5dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:02.854766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9775e-7e22-4b00-aeb2-cfb9f05f5dbf None admin] PATH_INFO: `/v3/users/15f3a1e7415a464795ffbe1c607dac8a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:02.856074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9775e-7e22-4b00-aeb2-cfb9f05f5dbf None admin] RBAC: Authorizing `identity:get_user(user_id=15f3a1e7415a464795ffbe1c607dac8a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:02.857601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9775e-7e22-4b00-aeb2-cfb9f05f5dbf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:02.859666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 170/327] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:03:02 2022] GET /identity/v3/users/15f3a1e7415a464795ffbe1c607dac8a => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:02.866126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:02.973249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555504-f418-43a0-a304-feece0e5c2c9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:03.002933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fade5-33d6-4fe9-beae-9ed4bf7c1eb8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:03.003233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fade5-33d6-4fe9-beae-9ed4bf7c1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:03.003492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fade5-33d6-4fe9-beae-9ed4bf7c1eb8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:03.004884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 171/328] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:03.011729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e47df-c064-4b13-8105-7abe9d3950fb None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:03.012018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e47df-c064-4b13-8105-7abe9d3950fb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:03.012297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e47df-c064-4b13-8105-7abe9d3950fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:03.012651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:03.013499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:03.013955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:03.014379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] PATH_INFO: `/v3/system/users/15f3a1e7415a464795ffbe1c607dac8a/roles/ac2d9625feb9489d874dbb22baa40e23` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:03.015987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15f3a1e7415a464795ffbe1c607dac8a, role_id=ac2d9625feb9489d874dbb22baa40e23)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:03.017515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:03.036691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d35e47df-c064-4b13-8105-7abe9d3950fb None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:03.037910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d35e47df-c064-4b13-8105-7abe9d3950fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:03.091104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 158/329] 10.222.0.71 () {58 vars in 1334 bytes} [Tue Aug 2 09:03:02 2022] PUT /identity/v3/system/users/15f3a1e7415a464795ffbe1c607dac8a/roles/ac2d9625feb9489d874dbb22baa40e23 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:03.097544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:03.117602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 172/330] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:03.142290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:03.202733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:03.266925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb28349-8beb-45ad-b171-63299eb322b2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:03.319625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:03.320272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:03.320546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:03.320821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:03.335532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:03.341660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:03.342563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:03.343359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 159/331] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:03.349003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e47df-c064-4b13-8105-7abe9d3950fb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:03.468864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e47df-c064-4b13-8105-7abe9d3950fb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:03.508210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:03.509549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:03.509894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:03.510172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:03.510896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] RBAC: Adding query filter params (name=member) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:03.511200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:03.512569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:03.521479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 173/332] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:03.528330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:03.646612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5995-4d94-4425-a567-0b2678d0ea6c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:03.655898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:03.684596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616756db-91d0-4f74-ad84-f3efeea60812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:03.685241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616756db-91d0-4f74-ad84-f3efeea60812 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:03.685521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616756db-91d0-4f74-ad84-f3efeea60812 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:03.685836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616756db-91d0-4f74-ad84-f3efeea60812 None admin] PATH_INFO: `/v3/users/cd8e47f421134e148520f186b5a2d767` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:03.687010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616756db-91d0-4f74-ad84-f3efeea60812 None admin] RBAC: Authorizing `identity:get_user(user_id=cd8e47f421134e148520f186b5a2d767)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:03.688523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616756db-91d0-4f74-ad84-f3efeea60812 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:03.690244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 160/333] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:03:03 2022] GET /identity/v3/users/cd8e47f421134e148520f186b5a2d767 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:03.695921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:03.753534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:03.820610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f12a3-d8d2-49fd-b196-86579b18e625 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:03.870686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44546a5-cddc-461f-9a1f-242336fea281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:03.871328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44546a5-cddc-461f-9a1f-242336fea281 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:03.871608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44546a5-cddc-461f-9a1f-242336fea281 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:03.871881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44546a5-cddc-461f-9a1f-242336fea281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:03.877740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44546a5-cddc-461f-9a1f-242336fea281 None admin] RBAC: Adding query filter params (role.id=15cbc1d04d5a479d9bf50df00a5e2506, user.id=cd8e47f421134e148520f186b5a2d767, scope.system=all) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:03.877740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44546a5-cddc-461f-9a1f-242336fea281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:03.877740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44546a5-cddc-461f-9a1f-242336fea281 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:03.892531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 174/334] 10.222.0.71 () {56 vars in 1308 bytes} [Tue Aug 2 09:03:03 2022] GET /identity/v3/role_assignments?user.id=cd8e47f421134e148520f186b5a2d767&scope.system=all&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:05.045336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5760d-f36a-4332-930f-4e86791d8a30 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:05.045846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5760d-f36a-4332-930f-4e86791d8a30 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:05.045920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5760d-f36a-4332-930f-4e86791d8a30 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:05.047279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 161/335] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:05.053861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e922d-7584-42cf-b6c8-8b5612de6783 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:05.054264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e922d-7584-42cf-b6c8-8b5612de6783 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:05.054448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e922d-7584-42cf-b6c8-8b5612de6783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:05.075970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1d9e922d-7584-42cf-b6c8-8b5612de6783 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:05.077177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1d9e922d-7584-42cf-b6c8-8b5612de6783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:05.164433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 175/336] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:05.201079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5760d-f36a-4332-930f-4e86791d8a30 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:05.332452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5760d-f36a-4332-930f-4e86791d8a30 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:05.377187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fe09-d3a5-40b8-a382-7c3683e8f7e8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:05.377499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fe09-d3a5-40b8-a382-7c3683e8f7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:05.379385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fe09-d3a5-40b8-a382-7c3683e8f7e8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:05.379511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:05.379511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:05.379666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 176/337] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:05.379734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:05.379821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:05.386352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0bcb-4575-4c6e-8f18-d59ecba47159 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:05.386889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0bcb-4575-4c6e-8f18-d59ecba47159 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:05.387369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0bcb-4575-4c6e-8f18-d59ecba47159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:05.410272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:05.421930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c52f0bcb-4575-4c6e-8f18-d59ecba47159 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:05.423402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c52f0bcb-4575-4c6e-8f18-d59ecba47159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:05.424120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:05.425007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:05.425866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:05.434054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 162/338] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:05.437895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:05.522695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:05.534206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:05.676069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 177/339] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:05.715231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8849-61e3-435a-ba61-db6036dbad6c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:05.759328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f0bcb-4575-4c6e-8f18-d59ecba47159 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:05.759783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:05.760652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:05.761280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:05.761808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:05.762784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:05.763304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:05.764902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:05.775060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 163/340] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:05.781018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:05.914241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:05.921454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5abd7-2434-44bf-bed4-59ec40b3cd47 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:05.970777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:05.971275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:05.971561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:05.971842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:06.070708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:06.072517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f0bcb-4575-4c6e-8f18-d59ecba47159 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:06.073115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:06.179855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:06.181597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:06.182492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:06.183275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:06.207111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:06.217438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 164/341] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:06.228354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:06.228585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:06.235170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:06.236981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:06.238891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:06.243491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 178/342] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:03:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:06.251780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:06.315154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:06.361479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf14654-96c6-418d-b5b8-d149e63193a1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:06.404259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:06.404909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:06.405195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:06.405472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:06.413751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:06.413751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:06.413751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 165/343] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:06 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:06.419170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:06.454736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e85a-6756-4519-b9f7-1253983bb075 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:06.509849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:06.534500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:06.535480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:06.535956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:06.536422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:06.537374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:06.537897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:06.539461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:06.553039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 179/344] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:06.559520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:06.560128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc15e1-4a33-429c-8a6b-eb01fe4c2a47 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:06.598945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:06.599846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:06.600130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:06.600410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:06.608397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:06.610312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:06.612558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 166/345] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:06 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:06.618794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:06.733188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:06.740835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bba1b-3f1c-428f-9173-3456523ead45 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:06.756115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e48525-1b9d-47f1-b2b4-5ab87010ea90 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:06.772818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:06.781993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:06.782683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:06.789095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:06.789095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:06.789095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=c668f8c374fa4ad5b058c689b07b7672) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:06.789095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:06.789095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:06.793516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 167/346] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:06 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:06.829137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25972b-a48b-4e3f-a1a5-9d25759d45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:06.830160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25972b-a48b-4e3f-a1a5-9d25759d45f9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:06.830638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25972b-a48b-4e3f-a1a5-9d25759d45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:06.831101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25972b-a48b-4e3f-a1a5-9d25759d45f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:06.949234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25972b-a48b-4e3f-a1a5-9d25759d45f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:06.950754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25972b-a48b-4e3f-a1a5-9d25759d45f9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:07.049080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:07.063907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 180/347] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:07.069186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:07.203904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522399d-9add-4b98-9dac-a4bc470b654c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:07.243698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:07.244329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.244635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.244895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.246190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:07.247658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:07.249668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 168/348] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:07 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:07.252358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3255-295c-4fae-8404-d73daac872df None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.252827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3255-295c-4fae-8404-d73daac872df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.252914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3255-295c-4fae-8404-d73daac872df None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.254689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 181/349] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:07.254981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:07.260758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0e60-2478-4bae-ab3e-860d0194cb1e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.261127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0e60-2478-4bae-ab3e-860d0194cb1e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.261478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0e60-2478-4bae-ab3e-860d0194cb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.302860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6b5a0e60-2478-4bae-ab3e-860d0194cb1e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:07.304085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6b5a0e60-2478-4bae-ab3e-860d0194cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:07.334271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:07.368846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae828d-ec33-482f-8903-0b8eeb9e95c6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:07.407275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:07.408427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.408913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.409390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.411043 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:07.413189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:07.416467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 169/350] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:07 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:07.422101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:07.451384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 182/351] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:07.473493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0829-687a-4c84-b601-fa961bc83505 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.473840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0829-687a-4c84-b601-fa961bc83505 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.474095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0829-687a-4c84-b601-fa961bc83505 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.475712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 183/352] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:07.483084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0486f75-e982-4e68-afdb-8de495a5b84f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.483368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0486f75-e982-4e68-afdb-8de495a5b84f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.483645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0486f75-e982-4e68-afdb-8de495a5b84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.518762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e0486f75-e982-4e68-afdb-8de495a5b84f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:07.520002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e0486f75-e982-4e68-afdb-8de495a5b84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:07.536355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7614c-ac47-4e38-8aa8-ff2249d44adf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:07.566178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:07.579445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:07.584624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.584624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.584624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.584624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=c668f8c374fa4ad5b058c689b07b7672) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:07.584624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:07.588222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:07.601616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 170/353] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:07 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=db362c02a23549c9815e38259950ff5c => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:07.605033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:07.660747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 184/354] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:07.703213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0486f75-e982-4e68-afdb-8de495a5b84f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:07.793343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:07.820119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d9668-c2d9-4bbf-9c79-ce9ff2c1f6d6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:07.913422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3bafb-f885-4a81-9068-e6bbb4189d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:07.914106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3bafb-f885-4a81-9068-e6bbb4189d22 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.914389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3bafb-f885-4a81-9068-e6bbb4189d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.914708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0486f75-e982-4e68-afdb-8de495a5b84f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:07.915510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3bafb-f885-4a81-9068-e6bbb4189d22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.943160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3bafb-f885-4a81-9068-e6bbb4189d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-40c3bafb-f885-4a81-9068-e6bbb4189d22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:07.950334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:07.951268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:07.952085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:07.954302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 171/355] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:07.955698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9f59-b238-476c-8318-9e5cc76eb61c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.956150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9f59-b238-476c-8318-9e5cc76eb61c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.956571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9f59-b238-476c-8318-9e5cc76eb61c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:07.958015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 172/356] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:07.961199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9f59-b238-476c-8318-9e5cc76eb61c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:07.980157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a93f-2579-4546-8c3b-3f48352eb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:07.981186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a93f-2579-4546-8c3b-3f48352eb101 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:07.981186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a93f-2579-4546-8c3b-3f48352eb101 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:07.981378 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a93f-2579-4546-8c3b-3f48352eb101 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.018601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a93f-2579-4546-8c3b-3f48352eb101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-aa15a93f-2579-4546-8c3b-3f48352eb101 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:08.023665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:08.024794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:08.025922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 185/357] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:03:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:08.026890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01517107-a605-42b9-8a87-e554850f83a1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.027176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01517107-a605-42b9-8a87-e554850f83a1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.027453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01517107-a605-42b9-8a87-e554850f83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.028630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:08.053750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-01517107-a605-42b9-8a87-e554850f83a1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:08.054963 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-01517107-a605-42b9-8a87-e554850f83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:08.094800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9f59-b238-476c-8318-9e5cc76eb61c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:08.141629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 186/358] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:08.142503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:08.143320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.143745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.144168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.145036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:08.145488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:08.146039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096fd8-65ba-4672-8c87-c363044185dc None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.146337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096fd8-65ba-4672-8c87-c363044185dc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.146617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096fd8-65ba-4672-8c87-c363044185dc None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.147690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:08.154209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 187/359] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:08.154819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096fd8-65ba-4672-8c87-c363044185dc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:08.157662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 173/360] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:08.162677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:08.218140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:08.294346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096fd8-65ba-4672-8c87-c363044185dc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:08.296290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e168b2c-38ef-4e75-8040-45ec651244dd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:08.315528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:08.333819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce50d5-ad4f-4d2f-9c87-982e919d1070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:08.334669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce50d5-ad4f-4d2f-9c87-982e919d1070 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.335116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce50d5-ad4f-4d2f-9c87-982e919d1070 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.335531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce50d5-ad4f-4d2f-9c87-982e919d1070 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.336414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce50d5-ad4f-4d2f-9c87-982e919d1070 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:08.337406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce50d5-ad4f-4d2f-9c87-982e919d1070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:08.339393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce50d5-ad4f-4d2f-9c87-982e919d1070 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:08.340924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:08.341756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.342051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.342332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.349007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 188/361] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:08.351369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008049-3e16-4ebd-ab8c-007eeb59d163 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.351837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008049-3e16-4ebd-ab8c-007eeb59d163 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.352838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008049-3e16-4ebd-ab8c-007eeb59d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.372668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-67008049-3e16-4ebd-ab8c-007eeb59d163 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:08.374256 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-67008049-3e16-4ebd-ab8c-007eeb59d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:08.437117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:08.438622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:08.454376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 189/362] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:08.455513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008049-3e16-4ebd-ab8c-007eeb59d163 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:08.530098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:08.569824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 174/363] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:08.577326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:08.599202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:08.603111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008049-3e16-4ebd-ab8c-007eeb59d163 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:08.649840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:08.650865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.651159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.651449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.666969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:08.674140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:08.675015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:03:08.675806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:08.678199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 190/364] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:08.682582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:08.710344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad4ce5-ac3f-42f6-a05f-41ed56641898 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:08.755701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:08.756328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.756612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.756894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.795252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:08.817105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac09-2607-4abb-922c-f5de09d3b8c6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:08.843946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:08.845432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:08.872974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:08.873626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:08.873946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:08.874225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:08.877611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:08.891844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:08.897261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:08.898210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:08.899758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:08.902673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 191/365] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:08.903682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:08.987089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 175/366] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:08.987960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.029287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35232017-c473-441f-b155-59b8ae2183c5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.072850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.073879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.074388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.074860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.076256 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.078051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.085022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 192/367] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:08 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.086316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.108996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:09.121664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1378efd-19b1-479f-a91f-161eb074614f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.154180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:09.175007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.180505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.180505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.180505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.180505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:09.180505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.180505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.191754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 176/368] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.192974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.220242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a9124-bbca-4e9d-81cb-8afd3a0ff119 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.262055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.263058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.263563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.264032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.264958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:09.265938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.268659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.279308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 193/369] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.280503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.332453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ddcfb-0045-4def-a2f1-574a37736c94 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.377386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.378519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.378519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.378704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.384719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.385282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.390716 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 177/370] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.391814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.403574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:09.427102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ae026-1114-4956-8f2a-52abc28c1015 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.462947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:09.484983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.485922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.486561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.486999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.489083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.491073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.494615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 194/371] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.495557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.534421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf4bb1-7614-4e36-bf02-34f2d643734e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.588775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.589950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.590430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.590783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] PATH_INFO: `/v3/users/15f3a1e7415a464795ffbe1c607dac8a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.592077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] RBAC: Authorizing `identity:get_user(user_id=15f3a1e7415a464795ffbe1c607dac8a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.594543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.596886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 178/372] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/users/15f3a1e7415a464795ffbe1c607dac8a => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.597948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.642846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187b583-4d3a-4d16-8759-79c56306ff99 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.684058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.684577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.684939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.685124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.704469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:09.739322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa890-7aa1-4546-9794-ed2d0b650153 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.756878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:09.782303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.783805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.787118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.787770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.788051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.788326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.793671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.793671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.799571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 179/373] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.802555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.923718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77453-ff38-402f-a2ec-f2d4e7fb2fa3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:09.931235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 195/374] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:09.932571 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:09.965810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225b6be-f759-4baa-961e-5b28d282d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:09.966364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225b6be-f759-4baa-961e-5b28d282d51b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.966647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225b6be-f759-4baa-961e-5b28d282d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.966934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225b6be-f759-4baa-961e-5b28d282d51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.967847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225b6be-f759-4baa-961e-5b28d282d51b None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=2f16b03fffc5439dabda794010e988aa) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:09.968038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225b6be-f759-4baa-961e-5b28d282d51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:09.969492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225b6be-f759-4baa-961e-5b28d282d51b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:09.975822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 180/375] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:09.976831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbcc2-c7fc-4319-b4e5-fd300aed6934 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:09.977656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbcc2-c7fc-4319-b4e5-fd300aed6934 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:09.978091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbcc2-c7fc-4319-b4e5-fd300aed6934 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:09.979571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 181/376] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:09.980105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbcc2-c7fc-4319-b4e5-fd300aed6934 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.030114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:10.053255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:10.084176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76a55a-14da-46e6-b8d7-8acee48ff480 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.134291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.134931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.135217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.135497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.136307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] RBAC: Adding query filter params (role.id=ac2d9625feb9489d874dbb22baa40e23, user.id=15f3a1e7415a464795ffbe1c607dac8a, scope.system=all) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:10.136621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:10.137470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbcc2-c7fc-4319-b4e5-fd300aed6934 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.140838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:10.155823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 196/377] 10.222.0.71 () {56 vars in 1308 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/role_assignments?user.id=15f3a1e7415a464795ffbe1c607dac8a&scope.system=all&role.id=ac2d9625feb9489d874dbb22baa40e23 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:10.156753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.191952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb030-222e-4082-849b-e93449d91154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.192597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb030-222e-4082-849b-e93449d91154 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.192880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb030-222e-4082-849b-e93449d91154 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.193157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb030-222e-4082-849b-e93449d91154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.195411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb030-222e-4082-849b-e93449d91154 None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=2f16b03fffc5439dabda794010e988aa) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:10.195737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb030-222e-4082-849b-e93449d91154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:10.197555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb030-222e-4082-849b-e93449d91154 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:10.207052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 182/378] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:09 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=db362c02a23549c9815e38259950ff5c => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:10.208384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0c73-2c19-457f-8819-925b59211211 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.208695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0c73-2c19-457f-8819-925b59211211 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.209006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0c73-2c19-457f-8819-925b59211211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.234394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-988d0c73-2c19-457f-8819-925b59211211 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:10.235566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-988d0c73-2c19-457f-8819-925b59211211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:10.313273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1523df0-bb90-467f-91fb-b055ad93c460 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.321931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:10.335100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 183/379] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:10.337809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e432-4dc1-4aa5-a960-a654fe101e17 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.340324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e432-4dc1-4aa5-a960-a654fe101e17 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.340853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e432-4dc1-4aa5-a960-a654fe101e17 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.344060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 184/380] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:10.360620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187e432-4dc1-4aa5-a960-a654fe101e17 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.372829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9953f2e-55b4-414f-99cd-f1f2885becc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.373495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9953f2e-55b4-414f-99cd-f1f2885becc6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.373833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9953f2e-55b4-414f-99cd-f1f2885becc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.374117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9953f2e-55b4-414f-99cd-f1f2885becc6 None admin] PATH_INFO: `/v3/projects/111a65792e6b4d558825e4b022d50a1d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.375397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9953f2e-55b4-414f-99cd-f1f2885becc6 None admin] RBAC: Authorizing `identity:get_project(project_id=111a65792e6b4d558825e4b022d50a1d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:10.384359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9953f2e-55b4-414f-99cd-f1f2885becc6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:10.384359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 197/381] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:10 2022] GET /identity/v3/projects/111a65792e6b4d558825e4b022d50a1d => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:10.384359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bde7d-0e0d-4d2f-a63c-535678f4305e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.384359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bde7d-0e0d-4d2f-a63c-535678f4305e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.384359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bde7d-0e0d-4d2f-a63c-535678f4305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.407244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6a3bde7d-0e0d-4d2f-a63c-535678f4305e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:10.408511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6a3bde7d-0e0d-4d2f-a63c-535678f4305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:10.444331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:10.528895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187e432-4dc1-4aa5-a960-a654fe101e17 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.570229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 198/382] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:10.571898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bde7d-0e0d-4d2f-a63c-535678f4305e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.579724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.581260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.581557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.581882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.595922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:10.601999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:10.603678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:10.604648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 185/383] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:10.611898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.717367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bde7d-0e0d-4d2f-a63c-535678f4305e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.720657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:10.737179 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:10.742277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2302402-787c-4cee-bcf7-27cd7cfbece9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.761887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.763910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.764219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.764502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] PATH_INFO: `/v3/groups/fcb317ccc7024fe4b5d5f6237f889c6c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.772403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] RBAC: Authorizing `identity:get_group(group_id=fcb317ccc7024fe4b5d5f6237f889c6c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:10.781066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:10.781066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 199/384] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:10 2022] GET /identity/v3/groups/fcb317ccc7024fe4b5d5f6237f889c6c => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:10.781066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.791255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.792040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.792397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.792828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.794210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:10.794586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:10.796288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:10.808130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 186/385] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:10.809345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.916743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cff28d-e2bb-441a-b2b2-474cefff3071 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.953759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33049e-0275-4bca-acf8-27f9bf79db16 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:10.962091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.962757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.963044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.963328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.977973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:10.985691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:10.986597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:10.987396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:10.988700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 200/386] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:03:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:10.988700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:10.996554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:10.997194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:10.997474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:10.997791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:10.998591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] RBAC: Adding query filter params (group.id=fcb317ccc7024fe4b5d5f6237f889c6c, role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=111a65792e6b4d558825e4b022d50a1d) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:10.998901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.000341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:11.007407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 187/387] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:10 2022] GET /identity/v3/role_assignments?group.id=fcb317ccc7024fe4b5d5f6237f889c6c&scope.project.id=111a65792e6b4d558825e4b022d50a1d&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:11.008116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:11.031507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:11.043468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:11.135989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4b905-68b8-4c18-9f5f-fd0a8da1f074 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:11.137046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720b700-d782-49f4-be64-33c1d564a7c8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:11.186368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:11.187157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:11.187568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:11.187914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:11.188849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:11.189250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.190171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:11.190726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:11.190902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:11.191085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:11.191367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:11.192881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.194891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:11.198035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 201/388] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:10 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:11.201049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 188/389] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:11.204443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:11.213168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:11.325336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:11.346178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:11.351007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb021-c896-4f40-b014-feccb849c4dd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:11.355650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328243d-2ab8-4d24-95de-f1d0ce48ad24 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:11.405614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:11.407018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:11.407964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:11.409377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:11.411509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.412321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:11.413506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:11.415290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:11.415788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:11.416278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:11.418645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.420350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:11.421360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 189/390] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:11 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:11.427565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 202/391] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:11 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:11.433625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:11.435645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:11.637521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6403d-f9ad-4f0c-9fb4-67d9277f29eb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:11.643740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eb6f5-0ea7-48af-bd50-448b48de56ac None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:11.708319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ddc09-a69a-48f1-975e-0f8101a3f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:11.709752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddc09-a69a-48f1-975e-0f8101a3f588 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:11.711217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddc09-a69a-48f1-975e-0f8101a3f588 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:11.712719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddc09-a69a-48f1-975e-0f8101a3f588 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672/groups/122b6bf9d15944baaadb23af5806496e/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:11.715635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:11.716544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:11.717449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ddc09-a69a-48f1-975e-0f8101a3f588 None admin] RBAC: Authorizing `identity:create_grant(project_id=c668f8c374fa4ad5b058c689b07b7672, group_id=122b6bf9d15944baaadb23af5806496e, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.717962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:11.718446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:11.720121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ddc09-a69a-48f1-975e-0f8101a3f588 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:11.723073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.724962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:11.728143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 203/392] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:11 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:11.736670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:11.781339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:11.825952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 190/393] 10.222.0.71 () {58 vars in 1442 bytes} [Tue Aug 2 09:03:11 2022] PUT /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672/groups/122b6bf9d15944baaadb23af5806496e/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:11.870797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d931a-74b8-4ac6-93b7-1a8ab2c4ccb8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:11.919583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad9098-8596-42e7-a536-c8c9d4a9104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:11.920247 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9098-8596-42e7-a536-c8c9d4a9104a None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:11.920532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9098-8596-42e7-a536-c8c9d4a9104a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:11.920804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9098-8596-42e7-a536-c8c9d4a9104a None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672/groups/122b6bf9d15944baaadb23af5806496e/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:11.923186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad9098-8596-42e7-a536-c8c9d4a9104a None admin] RBAC: Authorizing `identity:create_grant(project_id=c668f8c374fa4ad5b058c689b07b7672, group_id=122b6bf9d15944baaadb23af5806496e, role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:11.924726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad9098-8596-42e7-a536-c8c9d4a9104a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:12.058345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 204/394] 10.222.0.71 () {58 vars in 1442 bytes} [Tue Aug 2 09:03:11 2022] PUT /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672/groups/122b6bf9d15944baaadb23af5806496e/roles/db362c02a23549c9815e38259950ff5c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:03:12.439562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4e224-b7f4-4448-b64c-7dc7041e655c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:12.440562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4e224-b7f4-4448-b64c-7dc7041e655c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:12.441045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4e224-b7f4-4448-b64c-7dc7041e655c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:12.442923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 191/395] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:12.448375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8412-4137-4df3-b6c4-7cebe8fec5a9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:12.448847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8412-4137-4df3-b6c4-7cebe8fec5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:12.448936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8412-4137-4df3-b6c4-7cebe8fec5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:12.479029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ccab8412-4137-4df3-b6c4-7cebe8fec5a9 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:12.480253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ccab8412-4137-4df3-b6c4-7cebe8fec5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:12.573794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 205/396] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:12.611260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4e224-b7f4-4448-b64c-7dc7041e655c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:12.632642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:12.745090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4e224-b7f4-4448-b64c-7dc7041e655c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:12.787291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:12.787814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:12.788100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:12.788380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:12.791057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fdee5-fc54-4769-9926-3650cea125f3 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:12.791348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fdee5-fc54-4769-9926-3650cea125f3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:12.791625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fdee5-fc54-4769-9926-3650cea125f3 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:12.792973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 206/397] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:12.807343 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:12.811141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c253-b0b5-499e-bb8d-ce8261050ea8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:12.811428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c253-b0b5-499e-bb8d-ce8261050ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:12.811705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c253-b0b5-499e-bb8d-ce8261050ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:12.813095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:12.813977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:12.814777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 192/398] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:12.821742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:12.850841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7551c253-b0b5-499e-bb8d-ce8261050ea8 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:12.853700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7551c253-b0b5-499e-bb8d-ce8261050ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:12.895439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:12.925675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:12.952662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423392f2-8745-4fb6-b32b-bbfa26996fdf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:12.989151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:12.989829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:12.990145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:12.990466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:12.991203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:12.991511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:12.993016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:13.003465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 193/399] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:13.009576 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 207/400] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:13.012326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:13.031628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c253-b0b5-499e-bb8d-ce8261050ea8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:13.200190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05313cc-5517-4531-9ea5-eab5642ad1e0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:13.214925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c253-b0b5-499e-bb8d-ce8261050ea8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:13.263821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:13.264392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.264719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.265001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.266811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:13.268260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:13.269864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 194/401] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:13 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:13.276386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:13.276747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:13.277394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.277671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.277972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.281756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:13.304026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:13.314199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:13.315092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:13.315888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:13.316777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 208/402] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:03:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:13.324070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:13.357392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:13.404663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4e95-700f-4c64-a10f-cc6bd3e5dcc9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:13.440969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:13.442693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.443170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.443664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.445054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:13.447802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:13.450147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 195/403] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:13 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:13.455502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:13.542762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad04c9-2c99-4d1f-b843-1a8b179558a0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:13.599103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:13.615065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:13.616064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.616600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.617064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.618835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:13.619489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:13.621846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:13.639755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 209/404] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:13.648250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:13.667258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac4452-5e54-44d3-8b6d-ae060150b434 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:13.740862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82337549-4a14-4596-b4a3-40cb0a4e47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:13.741579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337549-4a14-4596-b4a3-40cb0a4e47e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.741896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337549-4a14-4596-b4a3-40cb0a4e47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.742181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337549-4a14-4596-b4a3-40cb0a4e47e0 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa/groups/122b6bf9d15944baaadb23af5806496e/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.745012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82337549-4a14-4596-b4a3-40cb0a4e47e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f16b03fffc5439dabda794010e988aa, group_id=122b6bf9d15944baaadb23af5806496e, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:13.746494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82337549-4a14-4596-b4a3-40cb0a4e47e0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:13.758412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:13.783088 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225bde-5291-4eb9-9c88-8496e15db150 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:13.816384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68a6d-9a53-4e04-8ce6-fa398ca84db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:13.816951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68a6d-9a53-4e04-8ce6-fa398ca84db0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.817231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68a6d-9a53-4e04-8ce6-fa398ca84db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.817507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68a6d-9a53-4e04-8ce6-fa398ca84db0 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.818681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68a6d-9a53-4e04-8ce6-fa398ca84db0 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:13.823041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68a6d-9a53-4e04-8ce6-fa398ca84db0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:13.823041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 210/405] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:13 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:13.823212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf9c9-fd50-42ef-907d-6e34e24f7fd5 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.823427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf9c9-fd50-42ef-907d-6e34e24f7fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.823702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf9c9-fd50-42ef-907d-6e34e24f7fd5 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.828958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 211/406] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:13.830023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf9c9-fd50-42ef-907d-6e34e24f7fd5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:13.851221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 196/407] 10.222.0.71 () {58 vars in 1442 bytes} [Tue Aug 2 09:03:13 2022] PUT /identity/v3/projects/2f16b03fffc5439dabda794010e988aa/groups/122b6bf9d15944baaadb23af5806496e/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:13.854163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48700-625b-4ec8-9ff1-aea4c9df2b0c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:13.854660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48700-625b-4ec8-9ff1-aea4c9df2b0c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:13.855146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48700-625b-4ec8-9ff1-aea4c9df2b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:13.880282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-85c48700-625b-4ec8-9ff1-aea4c9df2b0c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:13.882457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-85c48700-625b-4ec8-9ff1-aea4c9df2b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:13.982225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 197/408] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:14.003305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c48700-625b-4ec8-9ff1-aea4c9df2b0c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.054019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf9c9-fd50-42ef-907d-6e34e24f7fd5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.086177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:14.104072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.104783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.105068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.105698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.107258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.108986 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.111329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 212/409] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:13 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:14.117205 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.135327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c48700-625b-4ec8-9ff1-aea4c9df2b0c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.144589 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:14.174327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.175012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.175309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.175591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.187983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:14.193323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:14.201652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:14.202602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 198/410] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:14.204673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.325536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b068c-df82-49af-a15c-b6d5d7454627 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.369089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f81a7-5279-4008-be23-8c63613b7923 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.401153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:14.411271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb8407-119c-4a22-a24c-450dd2310085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.411944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8407-119c-4a22-a24c-450dd2310085 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.412228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8407-119c-4a22-a24c-450dd2310085 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.420497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8407-119c-4a22-a24c-450dd2310085 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa/groups/122b6bf9d15944baaadb23af5806496e/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.420497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb8407-119c-4a22-a24c-450dd2310085 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f16b03fffc5439dabda794010e988aa, group_id=122b6bf9d15944baaadb23af5806496e, role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.420784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb8407-119c-4a22-a24c-450dd2310085 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.427673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.428299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.428638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.428915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.429689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:14.430044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.432662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.442289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 199/411] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:14.448831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.520120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 213/412] 10.222.0.71 () {58 vars in 1442 bytes} [Tue Aug 2 09:03:14 2022] PUT /identity/v3/projects/2f16b03fffc5439dabda794010e988aa/groups/122b6bf9d15944baaadb23af5806496e/roles/db362c02a23549c9815e38259950ff5c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:14.541971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565c6d-8d7e-4c97-a52a-42008f12afe0 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.542263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565c6d-8d7e-4c97-a52a-42008f12afe0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.542548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565c6d-8d7e-4c97-a52a-42008f12afe0 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.543944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 214/413] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:14.553782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6420f2-76ee-4741-9a59-a48c3f45c86f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.554163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6420f2-76ee-4741-9a59-a48c3f45c86f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.554519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6420f2-76ee-4741-9a59-a48c3f45c86f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.556954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 215/414] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:14.562465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65e319-d4f7-48b8-afc1-939f5f76359b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.562847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65e319-d4f7-48b8-afc1-939f5f76359b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.563203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65e319-d4f7-48b8-afc1-939f5f76359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.570978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023159b5-fedb-427e-8bd3-29b1e13306cc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.583718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-dd65e319-d4f7-48b8-afc1-939f5f76359b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:14.585046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-dd65e319-d4f7-48b8-afc1-939f5f76359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.610888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d358e6-35f0-4670-b3fc-e746b5562c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.611550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d358e6-35f0-4670-b3fc-e746b5562c26 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.611892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d358e6-35f0-4670-b3fc-e746b5562c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.612169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d358e6-35f0-4670-b3fc-e746b5562c26 None admin] PATH_INFO: `/v3/groups/fcb317ccc7024fe4b5d5f6237f889c6c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.613445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d358e6-35f0-4670-b3fc-e746b5562c26 None admin] RBAC: Authorizing `identity:get_group(group_id=fcb317ccc7024fe4b5d5f6237f889c6c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.614983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d358e6-35f0-4670-b3fc-e746b5562c26 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.617014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 200/415] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/groups/fcb317ccc7024fe4b5d5f6237f889c6c => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:14.623764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf71d44-8275-4dd5-8566-583ff89baaa7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.624050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf71d44-8275-4dd5-8566-583ff89baaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.624332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf71d44-8275-4dd5-8566-583ff89baaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.644787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bdf71d44-8275-4dd5-8566-583ff89baaa7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:14.646090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bdf71d44-8275-4dd5-8566-583ff89baaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:14.664453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:14.671434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 216/416] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:14.678120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65e319-d4f7-48b8-afc1-939f5f76359b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.700023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:14.722673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 201/417] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:14.722910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf71d44-8275-4dd5-8566-583ff89baaa7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.809933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65e319-d4f7-48b8-afc1-939f5f76359b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.838833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf71d44-8275-4dd5-8566-583ff89baaa7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:14.859994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.860759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.861059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.861478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] PATH_INFO: `/v3/projects/111a65792e6b4d558825e4b022d50a1d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.865437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] RBAC: Authorizing `identity:get_project(project_id=111a65792e6b4d558825e4b022d50a1d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:14.867109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:14.874358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 217/418] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/projects/111a65792e6b4d558825e4b022d50a1d => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:14.875308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.893397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:14.894449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:14.894918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:14.895408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:14.907202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:14.912699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:14.913593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:14.914922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:14.917011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 202/419] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:14.918348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:14.960512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:14.966272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:15.004715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8fbf0-7ad3-425e-b207-ab26ba215c02 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:15.041754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffdc94-e9cb-44cc-a1c6-0b201905ca5e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:15.044105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:15.045080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:15.045557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:15.046047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:15.057403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:15.063070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:15.063920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:15.064706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:15.067539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 218/420] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:15.068621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:15.080382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:15.081059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:15.081338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:15.081614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] PATH_INFO: `/v3/projects/111a65792e6b4d558825e4b022d50a1d/groups/fcb317ccc7024fe4b5d5f6237f889c6c/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:15.083923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=111a65792e6b4d558825e4b022d50a1d, group_id=fcb317ccc7024fe4b5d5f6237f889c6c, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:15.085971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:15.157953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 203/421] 10.222.0.71 () {58 vars in 1442 bytes} [Tue Aug 2 09:03:14 2022] PUT /identity/v3/projects/111a65792e6b4d558825e4b022d50a1d/groups/fcb317ccc7024fe4b5d5f6237f889c6c/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:15.161507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:15.210182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f1828-af2f-4c67-b9f2-b1d68f6dadfe None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:15.271219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:15.286191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:15.290581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:15.290581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:15.290581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:15.290581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:15.290581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:15.290581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:15.312076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 219/422] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:15.316983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:15.376166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d21dc-4ff6-4eb8-96b8-0edaee561c01 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:15.378677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:15.427064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:15.427064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:15.427064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:15.427064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:15.427451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:15.427451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:15.428911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:15.440361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 204/423] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:15.445473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:15.505777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a53cc-1892-444e-a0ff-73fbe82cbd1f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:15.545387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:15.546075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:15.546308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:15.546592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:15.621078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1be9a-d36e-4529-b664-a0c2a32dc508 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:15.664994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:15.665628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:15.665933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:15.666210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:15.692226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:15.719133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:15.720430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:15.720612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:15.766049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:15.767546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:15.885607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 205/424] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:15.892056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:15.960728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 220/425] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:15.966653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.003964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:16.054231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01111a1-deef-4809-b422-2baac56e8dd4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.094978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.095639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.095921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.096197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.097368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:16.102862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:16.102862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 206/426] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:15 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:16.104946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:16.107641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.126793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfab8da-0252-4880-833b-667f08f5359a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.193222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.193893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.194177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.194448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] PATH_INFO: `/v3/projects/c668f8c374fa4ad5b058c689b07b7672` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.196791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c668f8c374fa4ad5b058c689b07b7672)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:16.198275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:16.204646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 221/427] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:15 2022] GET /identity/v3/projects/c668f8c374fa4ad5b058c689b07b7672 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:16.210356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.262247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c4a40-749f-45c4-971d-e6e4d5cf2325 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.301461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:16.308874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ec8b-786b-4d5e-9d73-f0764e1d4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.312409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ec8b-786b-4d5e-9d73-f0764e1d4b68 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.312409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ec8b-786b-4d5e-9d73-f0764e1d4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.312409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ec8b-786b-4d5e-9d73-f0764e1d4b68 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.314442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ec8b-786b-4d5e-9d73-f0764e1d4b68 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:16.316519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ec8b-786b-4d5e-9d73-f0764e1d4b68 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:16.319063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 207/428] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:16.320896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7077-7fbf-4930-88e7-a110fd6a3f65 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.321542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7077-7fbf-4930-88e7-a110fd6a3f65 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.322075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7077-7fbf-4930-88e7-a110fd6a3f65 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.325787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 208/429] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:16.326684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7077-7fbf-4930-88e7-a110fd6a3f65 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.348778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8c9f7-4e68-4899-b01e-35ccc6de04a0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.388610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58deeda5-2be4-446e-a999-c780b4e0599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.389264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deeda5-2be4-446e-a999-c780b4e0599f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.389579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deeda5-2be4-446e-a999-c780b4e0599f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.389878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deeda5-2be4-446e-a999-c780b4e0599f None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.391292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58deeda5-2be4-446e-a999-c780b4e0599f None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:16.392731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58deeda5-2be4-446e-a999-c780b4e0599f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:16.394676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 222/430] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:16.395887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec942-425e-4e76-9490-694617b21fec None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.396147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec942-425e-4e76-9490-694617b21fec None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.396428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec942-425e-4e76-9490-694617b21fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.417639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-93bec942-425e-4e76-9490-694617b21fec None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:16.419205 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-93bec942-425e-4e76-9490-694617b21fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:16.458108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:16.459282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7077-7fbf-4930-88e7-a110fd6a3f65 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.504467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 223/431] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:16.505633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec942-425e-4e76-9490-694617b21fec None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.518019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.518738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.519075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.519419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.520350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=c668f8c374fa4ad5b058c689b07b7672) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:16.520761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:16.522440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:16.530012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 209/432] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:16.538146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.673994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:16.722434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec942-425e-4e76-9490-694617b21fec None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.750248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289efd83-2acc-4f07-9066-d664fe1a9a55 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:16.775643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30217f69-c6de-4036-a26d-471969760a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.776279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217f69-c6de-4036-a26d-471969760a76 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.776632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217f69-c6de-4036-a26d-471969760a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.776996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217f69-c6de-4036-a26d-471969760a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.778954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30217f69-c6de-4036-a26d-471969760a76 None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=c668f8c374fa4ad5b058c689b07b7672) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:16.778954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30217f69-c6de-4036-a26d-471969760a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:16.780227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30217f69-c6de-4036-a26d-471969760a76 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:16.789368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 224/433] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=c668f8c374fa4ad5b058c689b07b7672&role.id=db362c02a23549c9815e38259950ff5c => generated 611 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:16.796954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:16.797739 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.798097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.798460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.809027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809dc5a-e82f-49f8-9fba-efa9d971726a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.809612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809dc5a-e82f-49f8-9fba-efa9d971726a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.810189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809dc5a-e82f-49f8-9fba-efa9d971726a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.812114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 225/434] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:16.814263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:16.817149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af830db0-9e28-4be4-b71f-6de116d0dc93 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:16.817654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af830db0-9e28-4be4-b71f-6de116d0dc93 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:16.818176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af830db0-9e28-4be4-b71f-6de116d0dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:16.819913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:16.821427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:03:16.822516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:16.823115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 210/435] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:16.835087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:16.850064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-af830db0-9e28-4be4-b71f-6de116d0dc93 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:16.851668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-af830db0-9e28-4be4-b71f-6de116d0dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:16.887396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:16.961149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 226/436] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:16.986144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af830db0-9e28-4be4-b71f-6de116d0dc93 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.005235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae52b-1c9e-4aa1-866e-3b9280d5ded6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.044551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.052300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.053172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.053508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.053887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.055865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:17.056328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:17.057837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:17.069641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 211/437] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:17.077894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.126746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af830db0-9e28-4be4-b71f-6de116d0dc93 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.168609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.169342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.169693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.170121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.185520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:17.191843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:17.192910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:17.193995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:17.198164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 227/438] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:03:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:17.200259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.216521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.219566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c870-f03a-46ed-88d4-469d4f2ebd19 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.260966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4059b8a-d5cc-4b18-ae39-0d4bd5b3c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.261965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059b8a-d5cc-4b18-ae39-0d4bd5b3c148 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.262480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059b8a-d5cc-4b18-ae39-0d4bd5b3c148 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.262934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059b8a-d5cc-4b18-ae39-0d4bd5b3c148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.334490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.345353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc0ee-7999-499e-81da-5d0cc761d9bc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.347735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4059b8a-d5cc-4b18-ae39-0d4bd5b3c148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:17.349606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4059b8a-d5cc-4b18-ae39-0d4bd5b3c148 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:17.398562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.398562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.398562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.398562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.399625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:17.399987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:17.401504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:17.410349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 228/439] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:17.416983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.489780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 212/440] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:17.492871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32cb12-7490-43ce-b27a-c012bb6f18b6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.493150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32cb12-7490-43ce-b27a-c012bb6f18b6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.493426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32cb12-7490-43ce-b27a-c012bb6f18b6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.494900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 213/441] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:17.496232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32cb12-7490-43ce-b27a-c012bb6f18b6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.519732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.549984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0fa5e-c588-417c-be10-2db1c3ca3351 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.582695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.584181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.584850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.585083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.585356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.598065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32cb12-7490-43ce-b27a-c012bb6f18b6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.632283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8950dd-ac9f-498a-a47a-da0c030c767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.632917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8950dd-ac9f-498a-a47a-da0c030c767b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.633886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8950dd-ac9f-498a-a47a-da0c030c767b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.634426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8950dd-ac9f-498a-a47a-da0c030c767b None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.635253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8950dd-ac9f-498a-a47a-da0c030c767b None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:17.636692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8950dd-ac9f-498a-a47a-da0c030c767b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:17.638374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 214/442] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:17.639468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537e0c-c432-4337-8b8d-15482d167199 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.639747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537e0c-c432-4337-8b8d-15482d167199 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.640021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537e0c-c432-4337-8b8d-15482d167199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.656644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:17.657311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-24537e0c-c432-4337-8b8d-15482d167199 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:17.658126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:17.658529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-24537e0c-c432-4337-8b8d-15482d167199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:17.723183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 215/443] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:17.724003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24537e0c-c432-4337-8b8d-15482d167199 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.728414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.760108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 229/444] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:17.760942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.816344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.834373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24537e0c-c432-4337-8b8d-15482d167199 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.862020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8ca7-746d-449a-8c77-11c88a498a50 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:17.873137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.873823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.874428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.874774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.876109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:17.877575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:17.879209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 216/445] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:17.879972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.902327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:17.902963 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:17.903247 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:17.903535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:17.913578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:17.919845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:17.920713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:17.921517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 230/446] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:17.922707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:17.952941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:17.983001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a62b21-a602-4fa3-926b-bd93629c80d3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.017902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.018530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.018805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.019085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] PATH_INFO: `/v3/projects/2f16b03fffc5439dabda794010e988aa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.020219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=2f16b03fffc5439dabda794010e988aa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.021656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.021826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79305e4-e5ac-420b-a981-404cf2dc62aa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.023316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 217/447] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/projects/2f16b03fffc5439dabda794010e988aa => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:18.025138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:18.047309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:18.060828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.061437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.061740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.062031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.062822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=15cbc1d04d5a479d9bf50df00a5e2506, scope.project.id=2f16b03fffc5439dabda794010e988aa) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:18.063134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.064565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.070495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 231/448] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:17 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=15cbc1d04d5a479d9bf50df00a5e2506 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:18.071859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:18.135192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8b8c-1810-47ff-be28-c1d083d57fa7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.174567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.175563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.176111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.176743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.177543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:18.177889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.179410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.193341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 218/449] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:18.194578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:18.195209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:18.203002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5a325-c251-4711-a23f-19b83e91c5dc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.246204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.246850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.247133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.247409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] PATH_INFO: `/v3/groups/122b6bf9d15944baaadb23af5806496e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.248585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] RBAC: Authorizing `identity:get_group(group_id=122b6bf9d15944baaadb23af5806496e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.250059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.252832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 232/450] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:18 2022] GET /identity/v3/groups/122b6bf9d15944baaadb23af5806496e => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:18.259372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:18.291274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:18.311361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99411bd0-d857-4112-ae2a-a095d3177006 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.356298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.356298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.356298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.356298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.379992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207ef5-fb64-4eff-ae2f-5837f0820349 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.424778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.425292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.425642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.425966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.426779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] RBAC: Adding query filter params (group.id=122b6bf9d15944baaadb23af5806496e, role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=2f16b03fffc5439dabda794010e988aa) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:18.427086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.428519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.435507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 233/451] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:18 2022] GET /identity/v3/role_assignments?group.id=122b6bf9d15944baaadb23af5806496e&scope.project.id=2f16b03fffc5439dabda794010e988aa&role.id=db362c02a23549c9815e38259950ff5c => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:18.439237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.440733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.528257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:18.547610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 219/452] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:18.553399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:18.584847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:18.660431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe26e8-92c6-4743-984f-329111f207a7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.695320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.695978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.696258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.696537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] PATH_INFO: `/v3/projects/111a65792e6b4d558825e4b022d50a1d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.697729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] RBAC: Authorizing `identity:get_project(project_id=111a65792e6b4d558825e4b022d50a1d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.699179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.701269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 234/453] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:03:18 2022] GET /identity/v3/projects/111a65792e6b4d558825e4b022d50a1d => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:18.706726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:18.809143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaa48d-f39e-4f6a-96e5-c9024c10198c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.842175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8ae8c-4255-49cb-bfb4-7a44af90da08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.842801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8ae8c-4255-49cb-bfb4-7a44af90da08 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.843082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8ae8c-4255-49cb-bfb4-7a44af90da08 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.843359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8ae8c-4255-49cb-bfb4-7a44af90da08 None admin] PATH_INFO: `/v3/groups/fcb317ccc7024fe4b5d5f6237f889c6c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.844494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8ae8c-4255-49cb-bfb4-7a44af90da08 None admin] RBAC: Authorizing `identity:get_group(group_id=fcb317ccc7024fe4b5d5f6237f889c6c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.846665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8ae8c-4255-49cb-bfb4-7a44af90da08 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.847539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 220/454] 10.222.0.71 () {56 vars in 1180 bytes} [Tue Aug 2 09:03:18 2022] GET /identity/v3/groups/fcb317ccc7024fe4b5d5f6237f889c6c => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:18.854490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:18.946724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:18.952374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0be89-9d7d-49ec-88d5-f0396408dc3e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:18.986130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ee9de-02c7-48a0-817b-93c73207eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:18.986729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee9de-02c7-48a0-817b-93c73207eff5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:18.987015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee9de-02c7-48a0-817b-93c73207eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:18.987293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee9de-02c7-48a0-817b-93c73207eff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:18.988080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ee9de-02c7-48a0-817b-93c73207eff5 None admin] RBAC: Adding query filter params (group.id=fcb317ccc7024fe4b5d5f6237f889c6c, role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=111a65792e6b4d558825e4b022d50a1d) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:18.988391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ee9de-02c7-48a0-817b-93c73207eff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:18.989846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ee9de-02c7-48a0-817b-93c73207eff5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:18.996531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 235/455] 10.222.0.71 () {56 vars in 1376 bytes} [Tue Aug 2 09:03:18 2022] GET /identity/v3/role_assignments?group.id=fcb317ccc7024fe4b5d5f6237f889c6c&scope.project.id=111a65792e6b4d558825e4b022d50a1d&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:21.397105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98dca-923c-4219-b7e1-ee691d054ba3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:21.398155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98dca-923c-4219-b7e1-ee691d054ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:21.399189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98dca-923c-4219-b7e1-ee691d054ba3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:21.400997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 221/456] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:21.406293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292a3a-484f-423b-829e-06ea286456e2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:21.407157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292a3a-484f-423b-829e-06ea286456e2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:21.407618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292a3a-484f-423b-829e-06ea286456e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:21.435496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-48292a3a-484f-423b-829e-06ea286456e2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:21.436953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-48292a3a-484f-423b-829e-06ea286456e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:21.533548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 236/457] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:21.579192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98dca-923c-4219-b7e1-ee691d054ba3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:21.621148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a604f8-25b0-4451-896a-63253fb785c3 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:21.621462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a604f8-25b0-4451-896a-63253fb785c3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:21.621706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a604f8-25b0-4451-896a-63253fb785c3 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:21.623457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 237/458] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:03:21.630587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe653-6fa8-42ee-9f4b-fc447726ffdc None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:21.631101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe653-6fa8-42ee-9f4b-fc447726ffdc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:21.631666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe653-6fa8-42ee-9f4b-fc447726ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:21.649631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:21.666783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3e5fe653-6fa8-42ee-9f4b-fc447726ffdc None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:21.667980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3e5fe653-6fa8-42ee-9f4b-fc447726ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:21.713083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98dca-923c-4219-b7e1-ee691d054ba3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:21.765902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 238/459] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:21.799352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:21.800009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:21.800291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:21.800564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:21.802881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe653-6fa8-42ee-9f4b-fc447726ffdc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:21.813819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:21.815651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:21.839098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:21.840205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:21.841262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:21.841262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:21.841262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:21.841262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:21.849692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 222/460] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:21.855008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:21.855117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:21.994855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe653-6fa8-42ee-9f4b-fc447726ffdc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.019694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf425c9-17fb-4dcd-914c-1dbe214aeb15 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.021528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.031361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c698dc-1474-49de-8d11-356b1ef9d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.039272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c698dc-1474-49de-8d11-356b1ef9d6ce None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.039272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c698dc-1474-49de-8d11-356b1ef9d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.039272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c698dc-1474-49de-8d11-356b1ef9d6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.043096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c698dc-1474-49de-8d11-356b1ef9d6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.044743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c698dc-1474-49de-8d11-356b1ef9d6ce None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:22.056329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4247ec-7416-4090-8414-d1000cec6338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.057143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4247ec-7416-4090-8414-d1000cec6338 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.057563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4247ec-7416-4090-8414-d1000cec6338 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.058265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4247ec-7416-4090-8414-d1000cec6338 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.059128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4247ec-7416-4090-8414-d1000cec6338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:22.059602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4247ec-7416-4090-8414-d1000cec6338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.061148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4247ec-7416-4090-8414-d1000cec6338 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c3c698dc-1474-49de-8d11-356b1ef9d6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:22.062222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:22.063278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:22.064417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:22.064417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:22.064417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:22.064417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:22.066110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 239/461] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:22.067642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a7900-214a-4d74-aef7-6d3685df5008 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.068107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a7900-214a-4d74-aef7-6d3685df5008 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.068620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a7900-214a-4d74-aef7-6d3685df5008 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.070169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 240/462] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:22.077770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a7900-214a-4d74-aef7-6d3685df5008 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.080088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 223/463] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:22.082586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79530-d24a-4643-b002-d666f3052fdc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.082878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79530-d24a-4643-b002-d666f3052fdc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.083152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79530-d24a-4643-b002-d666f3052fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.106138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-efd79530-d24a-4643-b002-d666f3052fdc None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:22.108017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-efd79530-d24a-4643-b002-d666f3052fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:22.158806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.193750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a7900-214a-4d74-aef7-6d3685df5008 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.201804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 224/464] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:22.202934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79530-d24a-4643-b002-d666f3052fdc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.246919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.248309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.249013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.249489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.250564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:22.251361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.253352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:22.269558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 241/465] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:22.276346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.334097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.343757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79530-d24a-4643-b002-d666f3052fdc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.387553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb2f74-a7ec-45be-b5f8-6b72bf971f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.388765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2f74-a7ec-45be-b5f8-6b72bf971f13 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.389675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2f74-a7ec-45be-b5f8-6b72bf971f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.390209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2f74-a7ec-45be-b5f8-6b72bf971f13 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.391104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb2f74-a7ec-45be-b5f8-6b72bf971f13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.393341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb2f74-a7ec-45be-b5f8-6b72bf971f13 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:22.410121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32110d-2704-4ebb-856c-b6f47dda13eb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.440885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.446566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.447206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.447482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.447801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.457742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.459173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:22.474676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:22.475579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:22.476595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:22.476595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:22.476595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:22.476595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:22.476595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 242/466] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:22.477625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.497953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 225/467] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:03:22 2022] POST /identity/v3/users => generated 246 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:22.497953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f252d5-2fe7-42f1-87b9-fe8610f6061f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.497953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f252d5-2fe7-42f1-87b9-fe8610f6061f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.497953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f252d5-2fe7-42f1-87b9-fe8610f6061f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.497953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 226/468] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:22.497953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f252d5-2fe7-42f1-87b9-fe8610f6061f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.620522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e32eb-3270-47a5-84fb-fbfb6d03e2b4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.630098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f252d5-2fe7-42f1-87b9-fe8610f6061f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.661612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.662298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.662587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.662870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.663602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.665660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:22.680792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ceb7-07d3-49ed-abb9-783ddc0ed43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.681901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ceb7-07d3-49ed-abb9-783ddc0ed43b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.682409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ceb7-07d3-49ed-abb9-783ddc0ed43b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.682858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ceb7-07d3-49ed-abb9-783ddc0ed43b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.683595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ceb7-07d3-49ed-abb9-783ddc0ed43b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:22.683906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ceb7-07d3-49ed-abb9-783ddc0ed43b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.685763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ceb7-07d3-49ed-abb9-783ddc0ed43b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:22.698932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 227/469] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:22.700172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c20df-207c-49b4-8227-d1846bf89107 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.700456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c20df-207c-49b4-8227-d1846bf89107 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.700732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c20df-207c-49b4-8227-d1846bf89107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.719761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a14c20df-207c-49b4-8227-d1846bf89107 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:22.720995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a14c20df-207c-49b4-8227-d1846bf89107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:22.723343 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.728552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 243/470] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:03:22 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:22.728714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.782474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.813702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 228/471] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:22.815348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad67ae-830a-408b-9d0a-6d2391a5d899 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.815678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad67ae-830a-408b-9d0a-6d2391a5d899 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.815965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad67ae-830a-408b-9d0a-6d2391a5d899 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.817360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 229/472] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:22.823766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22495-4e03-4df8-b6c3-23013accd443 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.824056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22495-4e03-4df8-b6c3-23013accd443 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.824339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22495-4e03-4df8-b6c3-23013accd443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.850170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-dfd22495-4e03-4df8-b6c3-23013accd443 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:22.851451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dfd22495-4e03-4df8-b6c3-23013accd443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:22.878778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80786c17-075b-4d40-8bb8-ad03793d0f92 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:22.937899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 230/473] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:22.942623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd22495-4e03-4df8-b6c3-23013accd443 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:22.965649 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:22.966707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:22.966989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:22.967261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:22.968108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:22.969559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:23.033664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:23.068025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd22495-4e03-4df8-b6c3-23013accd443 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:23.081128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 244/474] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:03:22 2022] POST /identity/v3/users => generated 248 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:23.082658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:23.125555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:23.126544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.126799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.127109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:23.153412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:23.157609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:23.196282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:23.197355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:23.198218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:23.198218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:23.198218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:23.198218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:23.202393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 231/475] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:23.203427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:23.296066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:23.302150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6420c-88ec-4d72-94a9-ef8d381dde7f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:23.344526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:23.345218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.345509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.345830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:23.346555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:23.348559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:23.363335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830614-0780-4b6a-ab27-c34ed2bad424 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:23.388354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.sql.core [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 09:03:23.388354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 09:03:23.388354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [parameters: {'id': 'f15656c5bf3249338a26c45e958b2ba1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 09:03:23.388354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 09:03:23.389708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:23.407484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:23.408176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.409872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.409872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:23.409872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:23.410084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:23.411382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result.read() Aug 02 09:03:23.419008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:03:23.420254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application yield resource Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise self.value Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application session.commit() Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 09:03:23.421167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.session.flush() Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application compat.raise_( Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 09:03:23.422310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:03:23.423628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result.read() Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:03:23.424680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [parameters: {'id': 'f15656c5bf3249338a26c45e958b2ba1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:23.425737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 09:03:23.428014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:23.429078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 245/476] 10.222.0.71 () {60 vars in 1131 bytes} [Tue Aug 2 09:03:23 2022] POST /identity/v3/roles => generated 144 bytes in 339 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:23.429163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 232/477] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:23.432619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:23.434600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:23.550121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea89e8-4e6c-4bd8-8c11-ebf2563bbec5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:23.571703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a54a-7a9f-41f0-a393-112123725649 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:23.587983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:23.588681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.588964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.589240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:23.600400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:23.608409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:23.609392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:23.610679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 233/478] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:03:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:23.617939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:23.621394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd0bae-2f75-4ea1-8ce2-044e40eb211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:23.622052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0bae-2f75-4ea1-8ce2-044e40eb211b None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.622340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0bae-2f75-4ea1-8ce2-044e40eb211b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.622664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0bae-2f75-4ea1-8ce2-044e40eb211b None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:23.623305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd0bae-2f75-4ea1-8ce2-044e40eb211b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:23.629766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd0bae-2f75-4ea1-8ce2-044e40eb211b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:23.682099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:23.723055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 246/479] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:03:23 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:23.750928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932c05-d435-41be-a2a5-fac80d05f3c5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:23.790240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cfa1c-45e1-483b-8ece-cc10478d75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:23.791133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cfa1c-45e1-483b-8ece-cc10478d75fc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:23.791564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cfa1c-45e1-483b-8ece-cc10478d75fc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:23.792059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cfa1c-45e1-483b-8ece-cc10478d75fc None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:23.792979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cfa1c-45e1-483b-8ece-cc10478d75fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:23.793441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cfa1c-45e1-483b-8ece-cc10478d75fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:23.795050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cfa1c-45e1-483b-8ece-cc10478d75fc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:23.805655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 234/480] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:25.141928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896089-80a8-4ee2-902a-cbe0f00c1ecf None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.142409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896089-80a8-4ee2-902a-cbe0f00c1ecf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.142409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896089-80a8-4ee2-902a-cbe0f00c1ecf None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.144018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 247/481] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:25.159092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e65b4-c947-4f7d-bc65-84835364f3c0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.159619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e65b4-c947-4f7d-bc65-84835364f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.159698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e65b4-c947-4f7d-bc65-84835364f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.164835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f04b-4b0b-49a3-9016-62d6792cdd6d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.165187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f04b-4b0b-49a3-9016-62d6792cdd6d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.165430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f04b-4b0b-49a3-9016-62d6792cdd6d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.167141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 248/482] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:25.174887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fcf07-9b6d-4d3b-9638-c582ee068340 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.175183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fcf07-9b6d-4d3b-9638-c582ee068340 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.175450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fcf07-9b6d-4d3b-9638-c582ee068340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.201650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-433fcf07-9b6d-4d3b-9638-c582ee068340 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:25.202886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-433fcf07-9b6d-4d3b-9638-c582ee068340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:25.205753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8f5e65b4-c947-4f7d-bc65-84835364f3c0 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:25.206937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8f5e65b4-c947-4f7d-bc65-84835364f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:25.226526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.325442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 249/483] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:25.327715 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 235/484] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:25.370946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fcf07-9b6d-4d3b-9638-c582ee068340 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:25.371170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e65b4-c947-4f7d-bc65-84835364f3c0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:25.403675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.480222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e65b4-c947-4f7d-bc65-84835364f3c0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:25.535784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:25.536537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.536895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.537246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.552846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:25.561754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:25.562863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:25.563861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 236/485] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:25.564732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fcf07-9b6d-4d3b-9638-c582ee068340 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:25.567119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:25.630946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:25.632553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.633536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.638113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.656245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:25.666866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:25.667959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:25.668973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:25.671379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 250/486] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:25.678626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:25.690935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.742454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.756933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013042-ee1b-4268-9baf-d08aa3f89899 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:25.830834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596e806-0039-42f0-afd4-469d6e740481 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:25.834086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3be204-795f-4881-a71f-7f5fd3b0aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:25.834701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3be204-795f-4881-a71f-7f5fd3b0aff2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.834984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3be204-795f-4881-a71f-7f5fd3b0aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.835257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3be204-795f-4881-a71f-7f5fd3b0aff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.837500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3be204-795f-4881-a71f-7f5fd3b0aff2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:25.837828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3be204-795f-4881-a71f-7f5fd3b0aff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:25.843823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3be204-795f-4881-a71f-7f5fd3b0aff2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:25.853623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 237/487] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:25.854929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2cfdf-584d-4ae1-9f45-23c4bd60a884 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.855212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2cfdf-584d-4ae1-9f45-23c4bd60a884 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.855485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2cfdf-584d-4ae1-9f45-23c4bd60a884 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.856690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 238/488] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:25.860304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2cfdf-584d-4ae1-9f45-23c4bd60a884 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:25.896169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42228452-69fc-484b-9cb9-1fe5927ec3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:25.897105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228452-69fc-484b-9cb9-1fe5927ec3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.897553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228452-69fc-484b-9cb9-1fe5927ec3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.897918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228452-69fc-484b-9cb9-1fe5927ec3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.898999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228452-69fc-484b-9cb9-1fe5927ec3d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:25.899353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228452-69fc-484b-9cb9-1fe5927ec3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:25.902911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228452-69fc-484b-9cb9-1fe5927ec3d1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:25.920257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 251/489] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:25.921507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece761-f1e0-4add-a4da-e27f11899da6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:25.921814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece761-f1e0-4add-a4da-e27f11899da6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:25.922092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece761-f1e0-4add-a4da-e27f11899da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:25.946531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-74ece761-f1e0-4add-a4da-e27f11899da6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:25.948556 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-74ece761-f1e0-4add-a4da-e27f11899da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:26.005070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2cfdf-584d-4ae1-9f45-23c4bd60a884 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.029227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.045810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 252/490] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:26.045810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ece761-f1e0-4add-a4da-e27f11899da6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.059935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.060669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.061793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.062303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.075648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.077921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:26.094055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:26.094930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:26.095745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:26.095745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:26.095745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.095745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:26.098038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 239/491] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:26.099018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.109513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.183839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ece761-f1e0-4add-a4da-e27f11899da6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.220916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.221561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.221877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.222154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.224178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea927-3c77-4207-aa88-6f61c6fa9ecf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.232938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.234427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:26.250112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:26.250947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:26.251801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:26.251801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:26.251801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.251801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:26.251801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 253/492] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:26.256597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.261387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a191-0ba8-49bf-8285-00f481bbf917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.261387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a191-0ba8-49bf-8285-00f481bbf917 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.261684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a191-0ba8-49bf-8285-00f481bbf917 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.261935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a191-0ba8-49bf-8285-00f481bbf917 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.272533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a191-0ba8-49bf-8285-00f481bbf917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a0a7a191-0ba8-49bf-8285-00f481bbf917 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:26.278618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:26.279478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:26.280296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 240/493] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:26.280981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4835aa-0d04-4610-815c-e50908f18e92 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.281817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4835aa-0d04-4610-815c-e50908f18e92 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.281817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4835aa-0d04-4610-815c-e50908f18e92 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.286679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 241/494] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:26.286679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4835aa-0d04-4610-815c-e50908f18e92 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.314558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.364153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.376270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda8df-130e-4bdc-ba27-a92fd8b5cf21 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.410146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4835aa-0d04-4610-815c-e50908f18e92 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.411140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd715863-fa12-4adf-8c0c-c9e14d77287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.411763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715863-fa12-4adf-8c0c-c9e14d77287f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.412042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715863-fa12-4adf-8c0c-c9e14d77287f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.412317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715863-fa12-4adf-8c0c-c9e14d77287f None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.413012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715863-fa12-4adf-8c0c-c9e14d77287f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:26.413323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715863-fa12-4adf-8c0c-c9e14d77287f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.415594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715863-fa12-4adf-8c0c-c9e14d77287f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.427466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 254/495] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:26.433168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a322eff-1a63-4159-b96c-f976a37fbc8a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.433168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a322eff-1a63-4159-b96c-f976a37fbc8a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.433168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a322eff-1a63-4159-b96c-f976a37fbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.451509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5a322eff-1a63-4159-b96c-f976a37fbc8a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:26.451669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.452225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.452505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.452625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5a322eff-1a63-4159-b96c-f976a37fbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:26.452778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.453465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:26.453800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.455176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.466873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 242/496] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:26.467665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.520399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 255/497] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:26.521366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a322eff-1a63-4159-b96c-f976a37fbc8a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.564882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.583401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc8fd-aa68-48df-bc02-55bc15d92c76 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.610665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.619642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344a158-d7aa-4581-b854-50b6dbc827bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.620373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a158-d7aa-4581-b854-50b6dbc827bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.620657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a158-d7aa-4581-b854-50b6dbc827bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.620976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a158-d7aa-4581-b854-50b6dbc827bb None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.621677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344a158-d7aa-4581-b854-50b6dbc827bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:26.622008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344a158-d7aa-4581-b854-50b6dbc827bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.623377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344a158-d7aa-4581-b854-50b6dbc827bb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.623512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a322eff-1a63-4159-b96c-f976a37fbc8a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.631173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 243/498] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:26.632454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212a82-c1e0-4af9-aa2c-a6b991298741 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.632744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212a82-c1e0-4af9-aa2c-a6b991298741 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.633791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212a82-c1e0-4af9-aa2c-a6b991298741 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.635189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 244/499] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:26.635883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00212a82-c1e0-4af9-aa2c-a6b991298741 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.663158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.663792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.664095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.664409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.671711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.673167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:26.686427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:26.687543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 256/500] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:26.688682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.747724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00212a82-c1e0-4af9-aa2c-a6b991298741 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.782514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.783156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.783444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.783722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.786711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.789628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269d9a7-6f00-4de4-a351-e2b371a4d8f7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.792817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.798058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:26.807447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:26.808510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:26.809822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:26.813134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 245/501] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:26.813997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.825831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f909ae-79ef-4016-8275-2483284180dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.826467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f909ae-79ef-4016-8275-2483284180dd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.826757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f909ae-79ef-4016-8275-2483284180dd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.827036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f909ae-79ef-4016-8275-2483284180dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.836892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f909ae-79ef-4016-8275-2483284180dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.838386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f909ae-79ef-4016-8275-2483284180dd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-70f909ae-79ef-4016-8275-2483284180dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:26.853139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:26.854197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:26.855169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:26.855169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:26.855169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.855169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:26.855169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 257/502] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:26.855450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77cc7c-6584-47f8-a9a9-612a9443cefc None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.855791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77cc7c-6584-47f8-a9a9-612a9443cefc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.855989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77cc7c-6584-47f8-a9a9-612a9443cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.865469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:26.875530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ac77cc7c-6584-47f8-a9a9-612a9443cefc None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:26.876725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ac77cc7c-6584-47f8-a9a9-612a9443cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:26.918078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f306-207d-42fd-af8c-2277adfb8447 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:26.943040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 258/503] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:26.943872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77cc7c-6584-47f8-a9a9-612a9443cefc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:26.964558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:26.965486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:26.965968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:26.966424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:26.977982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:26.979484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:26.996511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:26.997429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:26.998388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:26.998388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:26.998388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:26.998388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:26.998388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 246/504] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:26.998671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.037931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.056227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77cc7c-6584-47f8-a9a9-612a9443cefc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.091644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.092261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.092547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.092822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.093621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:27.093958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.095421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.101241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.104521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07f8e-abd5-4f45-bc12-1ce478146af8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.137777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 259/505] 10.222.0.71 () {56 vars in 1137 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:27.137777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.138027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.138378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.138665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.138943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.139751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:27.140058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.141574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.179196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 247/506] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:03:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:27.180622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.236554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48fd48-f2a8-4766-bfaa-46d66d235dfc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.270237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.270867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.271224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.271503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.272189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:27.272495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.274606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.280372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044523-b19d-4a39-aaf2-019c77e71683 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.282879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.286266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 260/507] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:27.287120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.323543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.324177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.324461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.324739 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.334932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:27.340570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:27.341622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 248/508] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:27.342681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.362129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.391954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ff3fe-6183-4e38-b4e6-85d2669ad94b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.425949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.426563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.426846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.427123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.427810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:27.428113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.429486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.441511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 261/509] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:27.442456 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.443148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941f462-7ab2-42b5-b3bc-db3ad7eeb5bb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.482344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.482961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.483236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.483910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.502644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.544817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d44fd-21be-458a-ba1a-c324f8a831dc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.550989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.552476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.571054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.582119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.583213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.583213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.583441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.650846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.651742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 249/510] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:27.652308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.652558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.709569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.750715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 262/511] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:27.751553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.752822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40244d-2154-429e-b20c-8656661a01c1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.770010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.786440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.787046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.787322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.787594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.788263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.790986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.847863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523819b6-04af-4911-a3ed-2b5bf7047a2e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:27.883060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:27.883671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:27.883954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:27.884227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:27.884929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:27.885232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:27.886644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:27.894288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 263/512] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:27.895058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:27.918595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:27.951077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 250/513] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:03:27 2022] POST /identity/v3/users => generated 247 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:27.951910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.000847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d5e6-09d9-4abc-a579-bbe37f1c6195 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.044740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.046244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.046678 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.047099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.058476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.060244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.068870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ac9d5-efb3-48c0-986b-7bd22b32e408 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:28.073060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:28.074228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:03:28.075321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:28.079013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 264/514] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:28.079952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.110952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.112326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.112326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.112326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.124013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.125468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:28.142265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:28.143274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:28.144136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:28.144136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:28.144136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:28.144136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:28.145860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 251/515] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:28.146821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.178545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.184466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.203520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0943bac-9b18-4b33-9e5a-58f8b07bbd73 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.240181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.240832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.241085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.241365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.252481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.253967 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.258041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d784bc-2382-4e85-9711-98b089772aa3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:28.270061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:28.270922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:28.271783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:28.271783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:28.271783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:28.271783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:28.277887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 265/516] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:28.277887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.296252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.296951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.297232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.297565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.308418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.309914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:28.325592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:28.326497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:28.327341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:28.327341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:28.327341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:28.327341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:28.327341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 252/517] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:28.327612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.394820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc438424-91b9-481e-a609-346f18755b78 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.408465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.430538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b2b9-71dc-493c-99fc-8d86831707a8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.434351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.435206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.435679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.436148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.437130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:28.437664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.439301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.441332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.462212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 266/518] 10.222.0.71 () {56 vars in 1137 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:28.462212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.475654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.476268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.477090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.477394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.478170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:28.478475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.479915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.491861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 253/519] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:28.492606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.574255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529bb19-ed4a-4a95-b793-c9fa65458da0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.596141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d029c8-001d-4fa0-94e9-262efc342a87 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.611495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.612321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.612745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.613276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.614269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:28.614714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.616236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.629045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 267/520] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:28.629894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.638044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.638877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.639296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.639696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.640531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:28.641028 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.642587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.650861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.660478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 254/521] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:28.660478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.691582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.747741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5250b-9cb0-4935-98e1-35c9c6ba5c50 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.770157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3fff-8a61-4923-a094-c90085453ad7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.791092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.791835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.792310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.792513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.809631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.810310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.810589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.810864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:28.817615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.819131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:28.832002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:28.833023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 255/522] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:28.839286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.876434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:28.877944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:28.911202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.932137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:28.957415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456c33c-f75e-4202-be78-36f5202a1503 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:28.985133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 268/523] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:28.986306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:28.998592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:28.999233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:28.999510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:28.999780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.006458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.008049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:29.020292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:29.021157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 256/524] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:29.022430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.101257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87f2eb-8ec3-44fe-a234-ad2eaa9119d3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.138579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.139020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a8d48-5fbf-4e90-a07f-7822e06834ab None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.139230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.139515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.139793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.147637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.149117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.157029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:29.161130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:29.162106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 269/525] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:29.170200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.181613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.182273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.182484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.182583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.182817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.183581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:29.183890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.185369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.208076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 257/526] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:29.208076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.278144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dcb15-c297-42b3-ae4e-5d03b29d104b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.309397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97bca-1c8a-4503-add3-821a7f9ed58e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.314847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.315487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.315769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.316048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.327463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.328928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:29.343734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:29.344601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:29.345436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:29.345436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:29.345436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:29.345436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:29.346583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.347405 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.347694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.347974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.348785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:29.349552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.349746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 270/527] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:29.350571 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.351057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.365272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 258/528] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:29.365272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.410849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.422385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.461451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373688e4-07c1-4082-a928-ad9d1702b2b0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.475850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be320d5d-392e-47bf-827a-3c2a58d855c8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.496901 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.497520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.497830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.498112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.498911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:29.499218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.500670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.518178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.523478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 271/529] 10.222.0.71 () {56 vars in 1139 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:29.523621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.523621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.523790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.523862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.523862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=06a2008ab3a2497eba5e8394277c2316) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:29.523862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.523862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.537871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 259/530] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/role_assignments?user.id=06a2008ab3a2497eba5e8394277c2316&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:29.537871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.640470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8158b4-f006-45ee-ab72-976932324b29 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.671117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.685877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.686414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.686725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.687658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.688484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:29.688799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.690496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.692650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71d41-37f8-4dcb-bc29-dddc473c5f1a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.694911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:29.707055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 272/531] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:29.711748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.740637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.741257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.741541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.741856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.743185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8771927999ea4471a4673dead83336e5) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:29.743598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.745060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:29.757828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 260/532] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/role_assignments?user.id=8771927999ea4471a4673dead83336e5&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:29.757828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:29.883065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842e482-4e4d-470d-90b7-af030403e17b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.933408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c54c78-66bd-481e-9309-2317625da1a3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:29.977533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.979874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.980694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f9724-5063-4e1e-9abb-32921caf8849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:29.981194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.982039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9724-5063-4e1e-9abb-32921caf8849 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:29.982169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.982666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9724-5063-4e1e-9abb-32921caf8849 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:29.983207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9724-5063-4e1e-9abb-32921caf8849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:29.992439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:29.993331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:30.009660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:30.010616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:30.011469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:30.011874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 261/533] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:30.018569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:30.060199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:30.071230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:30.095245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f9724-5063-4e1e-9abb-32921caf8849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:30.097546 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f9724-5063-4e1e-9abb-32921caf8849 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:30.144999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502ab44-afe0-4c15-bfbf-f178c0396b02 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:30.189747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fb40c-a574-460a-8a94-264b0d2e7819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:30.189747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb40c-a574-460a-8a94-264b0d2e7819 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.189747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb40c-a574-460a-8a94-264b0d2e7819 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.189747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fb40c-a574-460a-8a94-264b0d2e7819 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.190220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fb40c-a574-460a-8a94-264b0d2e7819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:30.190220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fb40c-a574-460a-8a94-264b0d2e7819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:30.190220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fb40c-a574-460a-8a94-264b0d2e7819 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:30.204336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 262/534] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:30.205787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61dce-3d08-461b-8cb1-d6b18529bfff None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.206082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61dce-3d08-461b-8cb1-d6b18529bfff None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.206362 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61dce-3d08-461b-8cb1-d6b18529bfff None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.207952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 263/535] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:30.210407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef61dce-3d08-461b-8cb1-d6b18529bfff None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:30.233706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 273/536] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:30.234924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227cd6a-5bb7-4108-bd69-574535bc8cfc None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.235208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227cd6a-5bb7-4108-bd69-574535bc8cfc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.235478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227cd6a-5bb7-4108-bd69-574535bc8cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.255431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5227cd6a-5bb7-4108-bd69-574535bc8cfc None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:30.256797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5227cd6a-5bb7-4108-bd69-574535bc8cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:30.310757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:30.329850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef61dce-3d08-461b-8cb1-d6b18529bfff None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:30.338018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 274/537] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:30.339511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227cd6a-5bb7-4108-bd69-574535bc8cfc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:30.362287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:30.373271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:30.373977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.376489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.376775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.377584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=71adb0143db64ca68f9c3846951adb30) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:30.377927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:30.379397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:30.396036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 264/538] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/role_assignments?user.id=71adb0143db64ca68f9c3846951adb30&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:30.396036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:30.521829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f62d-422d-47a4-9659-b1427f5b14cd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:30.562752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:30.563799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.564274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.564760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.588403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227cd6a-5bb7-4108-bd69-574535bc8cfc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:30.589027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:30.596173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:30.597053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:30.597889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:30.604975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 265/539] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:30.606278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:30.626083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:30.655669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:30.656680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.657217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.657711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.669685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:30.672438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:30.689267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:30.690177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:30.691015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:30.691015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:30.691015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:30.691015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:30.693178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 275/540] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:30.699218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:30.778280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:30.813345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882eb9c8-888c-49f9-bb6d-8ce8c89e5f05 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:30.820819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31268606-4909-42ea-b6d2-cf94618d9822 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:30.868158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:30.869535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.870032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.870498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.871404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:30.871899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:30.873535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:30.890032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:30.890660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:30.890946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:30.891239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:30.891960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:30.892266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:30.893661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:30.896353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 276/541] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:30.902696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:30.913618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 266/542] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:30.921273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.050222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:31.061991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435605ed-15f3-45c4-a435-ed41fa481351 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.102867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cc2d3-cf8d-4fbc-87ce-6034a5efec8d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.118577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:31.131047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.131689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.131977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.132256 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.143229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.144684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:31.157399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:31.158282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:31.159128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 277/543] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:31.164617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.167082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.167899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.168400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.168815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.196572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.198481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:31.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:31.225684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:31.226879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:31.226879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:31.226879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:31.226879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:31.234307 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 267/544] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:31.241566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.275445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de168f7-2aca-46fc-aee7-19bba7d7f6f6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.310502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.311045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.311329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.311604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.312361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:31.312669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.314162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.332772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 278/545] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:31.341152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.426009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe05f9-2473-42c5-9286-c47fd748c664 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.444557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:31.458144 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:31.462988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.463823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.464266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.464700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.466723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:31.466723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.467724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.481989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 268/546] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:31.486989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.574945 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f98da8-c070-467b-a705-4b67f5ed5d93 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.600718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62654-1d9d-43f0-a10e-cbe27e03504b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.640295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.640934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.641216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.641492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.650082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.652135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:31.665170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:31.666814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:31.668385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 269/547] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:31.669099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.669099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.669099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.669099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.669410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8f8fdc63709648dfbefb06f1b2db7ac0) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:31.669410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.670752 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.674710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.684281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 279/548] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:31 2022] GET /identity/v3/role_assignments?user.id=8f8fdc63709648dfbefb06f1b2db7ac0&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:31.750225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:31.826155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdbb94-5ffd-4f6e-81d9-aa64c5a964eb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:31.880949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5479-b730-4fa2-bb48-e5f093b5e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:31.881596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5479-b730-4fa2-bb48-e5f093b5e14d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.881907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5479-b730-4fa2-bb48-e5f093b5e14d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.882187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5479-b730-4fa2-bb48-e5f093b5e14d None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.883284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5479-b730-4fa2-bb48-e5f093b5e14d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:31.883838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5479-b730-4fa2-bb48-e5f093b5e14d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:31.885483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5479-b730-4fa2-bb48-e5f093b5e14d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:31.917866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 270/549] 10.222.0.71 () {56 vars in 1135 bytes} [Tue Aug 2 09:03:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:31.923595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:31.973655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fceb44-e63d-47e7-9fa8-8012b613927b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.974001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fceb44-e63d-47e7-9fa8-8012b613927b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.974270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fceb44-e63d-47e7-9fa8-8012b613927b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:31.975965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 271/550] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:31.982260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778133c3-5d5b-4603-9070-134537ecbe5b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:31.982845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778133c3-5d5b-4603-9070-134537ecbe5b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:31.983361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778133c3-5d5b-4603-9070-134537ecbe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.003474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-778133c3-5d5b-4603-9070-134537ecbe5b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:32.005132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-778133c3-5d5b-4603-9070-134537ecbe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:32.053951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f845-84b9-4961-844e-1b0dff4ee49d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:32.070049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.126551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:32.127112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.127393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.127666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.136699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 272/551] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:32.138080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2eb4a-e75d-4f61-b2fc-9a3f609955e2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.138371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2eb4a-e75d-4f61-b2fc-9a3f609955e2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.138654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2eb4a-e75d-4f61-b2fc-9a3f609955e2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.143838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 273/552] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:32.147008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023eca2-3417-4cb0-a4d3-470d127228e4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.147538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023eca2-3417-4cb0-a4d3-470d127228e4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.148010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023eca2-3417-4cb0-a4d3-470d127228e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.179712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c023eca2-3417-4cb0-a4d3-470d127228e4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:32.181274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c023eca2-3417-4cb0-a4d3-470d127228e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:32.208908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:32.210422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:32.218010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.277856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 274/553] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:32.279724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023eca2-3417-4cb0-a4d3-470d127228e4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:32.320704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 280/554] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:32.322432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:32.333787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.401884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023eca2-3417-4cb0-a4d3-470d127228e4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:32.440418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:32.442381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.443119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.443597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.454669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20c86d-780b-4fd9-b8b2-e28b28abb804 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:32.465271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:32.472826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:32.473750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:32.474916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:32.482037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 275/555] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:32.482037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:32.500656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:32.501312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.501597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.501903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.514090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:32.515930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:32.519665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:32.520562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:32.521393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 281/556] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:32.522575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:32.597820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.622016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e17f98-02a5-4741-81db-2d54bdef90f3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:32.638184 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f025-986c-4095-84b7-975c365d89ba None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:32.657589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:32.658199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.658481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.658757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.669311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:32.672148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:32.684416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:32.685355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.685875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.686354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.687266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:32.687787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:32.688539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:32.689854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:32.690780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:32.690780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:32.690780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:32.690780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:32.690780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 276/557] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:32.691089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:32.692554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:32.708962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 282/558] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:32.708962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:32.783553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.809949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882008c0-d7bf-4ae8-a72f-f81a138e86fb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:32.823422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f691d-fa3e-49c2-a3d2-4ed123e68c8d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:32.846553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:32.847536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.848032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.848439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.849177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:32.849759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:32.851141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:32.855518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:32.859880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 277/559] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:32.860728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:32.866596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c0fa7-0843-4a9e-8533-83ca9ce32039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:32.867796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c0fa7-0843-4a9e-8533-83ca9ce32039 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.868256 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c0fa7-0843-4a9e-8533-83ca9ce32039 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.868540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c0fa7-0843-4a9e-8533-83ca9ce32039 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.875282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c0fa7-0843-4a9e-8533-83ca9ce32039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:32.875282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c0fa7-0843-4a9e-8533-83ca9ce32039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:32.875282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c0fa7-0843-4a9e-8533-83ca9ce32039 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:32.883899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 283/560] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:32.885176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507a49-c051-426b-8159-3265f7b2e444 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:32.885471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507a49-c051-426b-8159-3265f7b2e444 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:32.885789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507a49-c051-426b-8159-3265f7b2e444 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:32.887096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 284/561] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:32.887749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f507a49-c051-426b-8159-3265f7b2e444 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.011103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc90d-492d-4e53-acaf-bb289f9855c2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.012161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f507a49-c051-426b-8159-3265f7b2e444 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.046865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19336a-8a01-4ddf-876d-f58cb9592efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.047166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.047501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19336a-8a01-4ddf-876d-f58cb9592efe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.047708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.047808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19336a-8a01-4ddf-876d-f58cb9592efe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.047983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.048080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19336a-8a01-4ddf-876d-f58cb9592efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.048260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.050913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.060014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.061062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19336a-8a01-4ddf-876d-f58cb9592efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.061480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.062546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19336a-8a01-4ddf-876d-f58cb9592efe None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:33.078103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:33.087970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:33.088856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:33.088856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:33.088856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:33.088856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ee19336a-8a01-4ddf-876d-f58cb9592efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:33.089077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:33.089970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:33.090847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:33.090847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:33.090847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:33.090847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:33.091069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 285/562] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:33.091069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.091203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 278/563] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:33.091203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d931e-3a9f-448d-978e-b4e990e425e5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.091203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d931e-3a9f-448d-978e-b4e990e425e5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.091203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d931e-3a9f-448d-978e-b4e990e425e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.106354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ba2d931e-3a9f-448d-978e-b4e990e425e5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:33.107953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ba2d931e-3a9f-448d-978e-b4e990e425e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:33.130783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.178460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 279/564] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:33.179296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d931e-3a9f-448d-978e-b4e990e425e5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.202903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0d2f8-9b80-4a9b-8f87-abcc12b2f986 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.240207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.241079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.241505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.242060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.250008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.251647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:33.264346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:33.265449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:33.266592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:33.268631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 286/565] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:33.269555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.295052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d931e-3a9f-448d-978e-b4e990e425e5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.314908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.333118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.333760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.334051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.334333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.335077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:33.335386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.336970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.348937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 280/566] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:33.350368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.389372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e370a15-adda-40ff-9fca-ecc5452fcce1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.391098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.426990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.427606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.427894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.428170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.428859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:33.429163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.431107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.442500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 287/567] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:33.443311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.460470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a8a9b-a96b-4428-9fdd-5cb8e80d6986 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.496482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.497125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.497409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.497684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.509398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:33.514794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:33.515714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:33.516577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 281/568] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:33.517265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.560520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.561402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264515-8758-400c-bed8-1c1afb6b182a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.596449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.597070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.597351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.597624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.598572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:33.598876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.600547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.612925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 288/569] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:33.613759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.628714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1854f-0242-457d-b405-a9f6e0fb8b4a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.641846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.664524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.665173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.665450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.665807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.673448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.674928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:33.686283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:33.687278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 282/570] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:33.688282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.725192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f13d-9a1a-4085-a69d-05c06a05ea2e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.761503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.762166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.762451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.762724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.769954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.771329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:33.783126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:33.784138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 289/571] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:33.785092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.796807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.800404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb40a8a-69f9-4c9e-ad0d-ab534bbe8ad3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.836965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.837592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.837909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.838259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.838981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:33.839288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.840685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.849777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 283/572] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:33.849957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.888329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:33.906484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de443fdb-b07d-4bc8-a1a4-979cb9251b09 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.940347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.940958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.941253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.941533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.942356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=72bd8d0e197643a58f5becd38d1ab474) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:33.942671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.944091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:33.950051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 290/573] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/role_assignments?user.id=72bd8d0e197643a58f5becd38d1ab474&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:33.950831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:33.955432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173275c-06d6-4147-90c9-251358dfdf33 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:33.995019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffafc7f-6a97-4226-a0a4-b7630a6a7eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:33.995763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffafc7f-6a97-4226-a0a4-b7630a6a7eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:33.996107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffafc7f-6a97-4226-a0a4-b7630a6a7eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:33.996455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffafc7f-6a97-4226-a0a4-b7630a6a7eb9 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:33.997409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffafc7f-6a97-4226-a0a4-b7630a6a7eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:33.997818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffafc7f-6a97-4226-a0a4-b7630a6a7eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:33.999450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffafc7f-6a97-4226-a0a4-b7630a6a7eb9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.021110 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 284/574] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:34.022197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21fafc-491a-4daf-be6c-9c19008e3b4c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.022484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21fafc-491a-4daf-be6c-9c19008e3b4c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.022762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21fafc-491a-4daf-be6c-9c19008e3b4c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.024773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 285/575] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:34.025364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21fafc-491a-4daf-be6c-9c19008e3b4c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.046411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.075380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0266c0-8eff-4e06-ac71-a8363ae69399 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.115973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.116695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.117002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.117284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.118382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:34.119162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.120113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.138226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 291/576] 10.222.0.71 () {56 vars in 1137 bytes} [Tue Aug 2 09:03:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:34.139063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.144756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.148106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21fafc-491a-4daf-be6c-9c19008e3b4c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.186431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44da6-515d-4847-af4d-d637bda63d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.187079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44da6-515d-4847-af4d-d637bda63d8b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.187366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44da6-515d-4847-af4d-d637bda63d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.188104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44da6-515d-4847-af4d-d637bda63d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.202125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44da6-515d-4847-af4d-d637bda63d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.204281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44da6-515d-4847-af4d-d637bda63d8b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c0f44da6-515d-4847-af4d-d637bda63d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:34.224752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:34.225682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:34.227349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:34.227349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:34.227349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:34.227349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:34.227349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 286/577] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:34.228648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea9cc1-6919-47d5-9129-5e6f7cd8e1c3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.228936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea9cc1-6919-47d5-9129-5e6f7cd8e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.229217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea9cc1-6919-47d5-9129-5e6f7cd8e1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.248482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-58ea9cc1-6919-47d5-9129-5e6f7cd8e1c3 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:34.249711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-58ea9cc1-6919-47d5-9129-5e6f7cd8e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:34.257106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb569c1a-023b-450d-a9e6-eab49037e8c2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.298882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.299521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.299803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.300079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.310999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.312468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:34.327731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:34.328614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:34.329515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:34.329515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:34.329515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:34.329515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:34.329515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 292/578] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:34.329825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.334769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.344794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 287/579] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:34.344794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea9cc1-6919-47d5-9129-5e6f7cd8e1c3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.402526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.451424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adfc07-e947-4e69-96b0-fa8a5eb8b126 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.452707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea9cc1-6919-47d5-9129-5e6f7cd8e1c3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.487105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.487743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.488029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.488307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.490451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.491188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.491469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.491749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.492502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:34.492810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.494240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.499270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.500701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.511627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 288/580] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:34.511627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:34.520392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:34.521427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:34.527206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:34.527206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:34.527206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:34.527206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:34.527206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 293/581] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:34.527206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.584618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.627291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17060358-58ec-4b2d-b0ff-772bdf1e94d3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.633977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376386e-8169-4b8a-bb40-d3503965effa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.643552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.662678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.663377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.663728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.664639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.665425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:34.665889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.667359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.672413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.673285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.673787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.674793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.684301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 289/582] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:34.684301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.692454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:34.698218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:34.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 294/583] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:34.700601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.796250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30b00-b47a-4ea2-91d2-9d735dc322e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.806651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46700dbb-d20f-4c9a-b65b-f71de6a9596e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.818222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.832082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.837538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.837538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.837538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.841205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.842793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.843515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:34.844129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:34.844406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:34.844688 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:34.845407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:34.845710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:34.847079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:34.856166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:34.857149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:03:34.858253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:34.859264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 290/584] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:34.859997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.872048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 295/585] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:34.872048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:34.902902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:34.974755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0337d6-40a5-43c1-91be-41f06142702e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:34.983998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36508a-92bc-4da8-a164-8d565af77862 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.010890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.011537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.011827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.012105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.019105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.020555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.025931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.026560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.026845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.027120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.028002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:35.028309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.029687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:35.032847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:35.033709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:35.034906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:35.038982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 291/586] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:35.043585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 296/587] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:35.043710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.043789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.091029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.139040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.148854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaaa3f-4043-4c35-9975-11a393f1cb2e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.154685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151c52-d6c6-45b2-ba06-b33a5011ef9c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.186988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.187718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.188066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.188408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.191100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.191712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.191997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.192275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.193073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:35.193657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.195248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.196047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.197465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:35.208756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:35.209630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:35.210663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 297/588] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:35.211167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.222467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 292/589] 10.222.0.71 () {56 vars in 1137 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:35.222467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.322160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb5d8-c86f-431b-abbb-925f4c7aca65 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.322497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.326564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c458-3997-4ab1-bc7a-2911a50aa1f2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.358779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.359455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.359806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.360167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.360951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:35.361329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.361823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.362530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.362883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.363031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.363294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.374931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.380909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 298/590] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:35.381050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.381148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.393347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:35.396631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:35.397745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:35.399064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:35.399064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:35.399064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:35.399064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:35.399531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 293/591] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:35.405277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.499225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9351c2-da81-414d-809a-8b0005e5321c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.513105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56d023-661a-4b7f-893a-497270906d13 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.536735 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.537439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.537745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.538031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.538815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:35.539180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.540898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.550103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.550749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.551031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.551307 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.559139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 299/592] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:35.559139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.568469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.570199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:35.585100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:35.586722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:35.587753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:35.587753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:35.587753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:35.587753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:35.587753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 294/593] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:35.592157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.595196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.634677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.668526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609a5c7-43ae-4372-a17b-6ffdc9405bda None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.699961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eaf19-a289-4664-8fa3-5652ef74aaae None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.706935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.707673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.708021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.708367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8771927999ea4471a4673dead83336e5/roles/2e815411a02a4cf19b45effcfbb0896c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.726673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=8771927999ea4471a4673dead83336e5, role_id=2e815411a02a4cf19b45effcfbb0896c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.728927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.735384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.736102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.736454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.736800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.737624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:35.738013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.739405 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.751915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 295/594] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:35.752701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.785127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 300/595] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:03:35 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8771927999ea4471a4673dead83336e5/roles/2e815411a02a4cf19b45effcfbb0896c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:35.794830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:35.823076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.879462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c5f8-2f5a-4ef2-8725-e89794b5b0c5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.935097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf4b12-7c07-4a94-b5a5-fd6cd7468b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.936636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4b12-7c07-4a94-b5a5-fd6cd7468b6c None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.937026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4b12-7c07-4a94-b5a5-fd6cd7468b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.937403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf4b12-7c07-4a94-b5a5-fd6cd7468b6c None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/06a2008ab3a2497eba5e8394277c2316/roles/2e815411a02a4cf19b45effcfbb0896c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.938551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bbe39-138e-4305-9e6b-689371907fb5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:35.962346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf4b12-7c07-4a94-b5a5-fd6cd7468b6c None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=06a2008ab3a2497eba5e8394277c2316, role_id=2e815411a02a4cf19b45effcfbb0896c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.963838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf4b12-7c07-4a94-b5a5-fd6cd7468b6c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.969630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:35.984084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:35.984795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:35.985084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:35.985363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:35.986113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:35.986417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:35.987790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:35.999835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 301/596] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:36.000725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.016623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 296/597] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:03:35 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/06a2008ab3a2497eba5e8394277c2316/roles/2e815411a02a4cf19b45effcfbb0896c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:36.018341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8a51-9f68-426e-b148-77201bc22236 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.018651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8a51-9f68-426e-b148-77201bc22236 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.019244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8a51-9f68-426e-b148-77201bc22236 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.021570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 297/598] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:36.023608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd8a51-9f68-426e-b148-77201bc22236 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.142525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37a5f-b342-4886-aab4-adcf15c14baa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.164607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd8a51-9f68-426e-b148-77201bc22236 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.181418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:36.185635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779df5d-d32a-4032-951e-d1eca49d3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.186512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779df5d-d32a-4032-951e-d1eca49d3b36 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.187017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779df5d-d32a-4032-951e-d1eca49d3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.187444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779df5d-d32a-4032-951e-d1eca49d3b36 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.196796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779df5d-d32a-4032-951e-d1eca49d3b36 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.198404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779df5d-d32a-4032-951e-d1eca49d3b36 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.205491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.206475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.206860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.207238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0779df5d-d32a-4032-951e-d1eca49d3b36 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:36.211783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:36.213137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:36.214197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 302/599] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:36.214783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44227f-c087-4dab-8900-9b83b3624fff None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.214851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44227f-c087-4dab-8900-9b83b3624fff None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.215312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44227f-c087-4dab-8900-9b83b3624fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.218892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.220424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:36.234118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:36.235211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:36.236328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:36.238467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 298/600] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:36.239470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.245812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7f44227f-c087-4dab-8900-9b83b3624fff None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:36.247037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7f44227f-c087-4dab-8900-9b83b3624fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:36.298393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:36.339196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 303/601] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:36.340187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44227f-c087-4dab-8900-9b83b3624fff None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.391133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cf007-2aed-4423-aa7f-b30cf5298850 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.427173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.427787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.428070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.428447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.429342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:36.430358 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.431793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.450150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44227f-c087-4dab-8900-9b83b3624fff None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.451252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 299/602] 10.222.0.71 () {56 vars in 1139 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:36.452020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.484802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:36.490493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.491302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.491794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.492745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.493657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:36.494215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.495894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.509798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 304/603] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:36.514922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.548467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:36.561341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d9073-10ea-429e-bcea-8caf15dc98e6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.596713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.597363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.597644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.597990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.610358 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:36.615439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:36.616355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:36.617776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 300/604] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:36.623131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.626549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec7b90-294c-474d-9f97-af68028185b0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.662925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.663572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.664454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.664747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.675856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.677380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:36.692269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:36.693188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:36.694119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:36.694119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:36.694119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:36.694119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:36.698691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 305/605] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:36.699595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.720204 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:36.730395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409de5a-bbb2-4d30-b37a-81376bd76410 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.780776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.781883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.782370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.782824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/71adb0143db64ca68f9c3846951adb30/roles/2e815411a02a4cf19b45effcfbb0896c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.794995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:36.807382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=71adb0143db64ca68f9c3846951adb30, role_id=2e815411a02a4cf19b45effcfbb0896c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.809846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.815238 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e1316-bcf7-464f-a7e7-ff6424be5ef4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:36.855153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:36.855778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:36.856110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:36.856391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:36.857109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:36.857419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:36.858876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:36.874438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 306/606] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:36.875207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:36.916725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 301/607] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:03:36 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/71adb0143db64ca68f9c3846951adb30/roles/2e815411a02a4cf19b45effcfbb0896c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:36.917562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.069778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfe40a-a30a-4241-b36d-10e2c3aae975 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.134794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca93b7-1e1c-4311-931e-3f202670702b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.138032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.138909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.139194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.139472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.140172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:37.140480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.141868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.161803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 307/608] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:37.167023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.172027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.194108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.194760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.195098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.195382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.208396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.212971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.214572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:37.234768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:37.235789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:37.236684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:37.236684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:37.236684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:37.236684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:37.241393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 302/609] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:37.249235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.289302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9ba44-09ce-4578-900c-14e353399518 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.326026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.327003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.327497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.328000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.336358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.338309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:37.352167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:37.353132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:37.354052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:37.356642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 308/610] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:37.362854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d86283-4431-4025-a5c2-c03e1236c000 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.372418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.401582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.402250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.402989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.402989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.403601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:37.403915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.405311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.423793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 303/611] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:37.425547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.454188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.493073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891f9f-7c7d-4eab-af58-0ba9af84891f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.531524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.586595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.587165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.587454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.587736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.588500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:37.588813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.590297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.591646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c9d8d-411f-4f20-ab14-435ca34ef2d8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.620274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 309/612] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:37.627696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.634470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.635423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.635984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.636463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.653431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.655437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:37.677510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:37.678509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:37.679599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:37.685835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 304/613] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:37.687994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.793357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da108f0-fdea-4e17-b56c-005f7a3edfa1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.826088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.834703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.837443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.837970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.838474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.839567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:37.841134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.846276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:37.887250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f29ae-c4f2-47e5-a91d-cafc362c5497 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:37.901634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 305/614] 10.222.0.71 () {56 vars in 1135 bytes} [Tue Aug 2 09:03:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:37.911674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:37.950171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:37.975026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d44d7c-58f5-456d-ab92-6012e6060b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:37.976052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d44d7c-58f5-456d-ab92-6012e6060b6d None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:37.976968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d44d7c-58f5-456d-ab92-6012e6060b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:37.977451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d44d7c-58f5-456d-ab92-6012e6060b6d None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8f8fdc63709648dfbefb06f1b2db7ac0/roles/2e815411a02a4cf19b45effcfbb0896c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:37.997308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d44d7c-58f5-456d-ab92-6012e6060b6d None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=8f8fdc63709648dfbefb06f1b2db7ac0, role_id=2e815411a02a4cf19b45effcfbb0896c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:37.999164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d44d7c-58f5-456d-ab92-6012e6060b6d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.051475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea935f4-d13b-45bb-81f3-db028c8cd90c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.069751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 310/615] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:03:37 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8f8fdc63709648dfbefb06f1b2db7ac0/roles/2e815411a02a4cf19b45effcfbb0896c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:03:38.070924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e090-c4f9-4bce-96d2-11f683cb937f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.071211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e090-c4f9-4bce-96d2-11f683cb937f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.074122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e090-c4f9-4bce-96d2-11f683cb937f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.078214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 311/616] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:38.083521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac4de-1570-4645-af28-04d5b466339a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.083806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac4de-1570-4645-af28-04d5b466339a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.086278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac4de-1570-4645-af28-04d5b466339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.119266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-852ac4de-1570-4645-af28-04d5b466339a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:38.120446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-852ac4de-1570-4645-af28-04d5b466339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:38.138458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.139134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.139419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.139699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.163346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.165600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:38.199708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:38.200673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:38.201570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:38.201570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:38.201570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:38.201570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:38.204360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 306/617] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:38.211402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.250098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:38.281907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 312/618] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:38.309214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac4de-1570-4645-af28-04d5b466339a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.348762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6f1b5-1be8-4a4d-befd-20d4775c1851 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.386201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.387156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.387665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.388240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.389239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:38.389790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.391428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.404985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 307/619] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:38.413075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.440952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac4de-1570-4645-af28-04d5b466339a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.446323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:38.481456 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58115d-f84a-44cf-9907-ea20a086a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.482493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58115d-f84a-44cf-9907-ea20a086a33f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.483001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58115d-f84a-44cf-9907-ea20a086a33f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.483621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58115d-f84a-44cf-9907-ea20a086a33f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.495676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58115d-f84a-44cf-9907-ea20a086a33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7d58115d-f84a-44cf-9907-ea20a086a33f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:38.501023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:38.505791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 313/620] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:38.506671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62574f-e096-4662-9e40-dd1140eab434 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.507679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62574f-e096-4662-9e40-dd1140eab434 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.507679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62574f-e096-4662-9e40-dd1140eab434 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.508903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 314/621] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:38.509803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62574f-e096-4662-9e40-dd1140eab434 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.558212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:38.566273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad23f6-f078-40f1-8228-16782c98826f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.604192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38aaa-882b-426e-ae16-82d4eab8bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.604830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38aaa-882b-426e-ae16-82d4eab8bb28 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.605116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38aaa-882b-426e-ae16-82d4eab8bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.605400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38aaa-882b-426e-ae16-82d4eab8bb28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.612875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa38aaa-882b-426e-ae16-82d4eab8bb28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.614438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa38aaa-882b-426e-ae16-82d4eab8bb28 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.623276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62574f-e096-4662-9e40-dd1140eab434 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4fa38aaa-882b-426e-ae16-82d4eab8bb28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:38.627458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:38.628360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:38.629287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:38.633468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 308/622] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:38.634917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c916f-ef28-43c1-a88a-c5d6eb8e4b69 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.635263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c916f-ef28-43c1-a88a-c5d6eb8e4b69 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.635544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c916f-ef28-43c1-a88a-c5d6eb8e4b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.655788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0c1c916f-ef28-43c1-a88a-c5d6eb8e4b69 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:38.657066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0c1c916f-ef28-43c1-a88a-c5d6eb8e4b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:38.664397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.665410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.665917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.666370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.667264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:38.667768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.669313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.678553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 315/623] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:38.680118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.709793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:38.742070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 309/624] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:38.743170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c916f-ef28-43c1-a88a-c5d6eb8e4b69 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.793493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01695e-171b-4334-b32a-4404993a2062 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.830189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.831115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.831788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.832297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.833223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:38.833705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.835329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.839641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:38.848947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 316/625] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:38.850303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.878461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c916f-ef28-43c1-a88a-c5d6eb8e4b69 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:38.917931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:38.918503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:38.918788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:38.919068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:38.931299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:38.932798 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:38.945768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:38.951748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:38.952678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:38.953596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:38.953596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:38.953596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:38.953596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:38.953596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 310/626] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:38.954109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:38.964788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb73ea-6535-40c9-a719-573836c89c0a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.004421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.005346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.005874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.006310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.018145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:39.023474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:39.024810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:39.025792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:39.028034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 317/627] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:39.028979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.096836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6c0bd-c630-4652-a03d-acff3cbeb506 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.126624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:39.138034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.140355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.140355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.140355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/72bd8d0e197643a58f5becd38d1ab474/roles/2e815411a02a4cf19b45effcfbb0896c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.147619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085af12-b9e0-4fd3-91f3-4a2cb33efdc2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.155811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=72bd8d0e197643a58f5becd38d1ab474, role_id=2e815411a02a4cf19b45effcfbb0896c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.157484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.187446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add691-2032-4038-9347-169b988f96bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.188111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add691-2032-4038-9347-169b988f96bd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.188396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add691-2032-4038-9347-169b988f96bd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.188671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add691-2032-4038-9347-169b988f96bd None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.189357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94add691-2032-4038-9347-169b988f96bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:39.189729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94add691-2032-4038-9347-169b988f96bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.191167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94add691-2032-4038-9347-169b988f96bd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.203283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 318/628] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:39.203910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add691-2032-4038-9347-169b988f96bd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.214838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:39.230477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 311/629] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:03:38 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/72bd8d0e197643a58f5becd38d1ab474/roles/2e815411a02a4cf19b45effcfbb0896c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:39.232159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.346383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add691-2032-4038-9347-169b988f96bd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.362114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d26c9-a284-4354-a6f1-f20b471e14f7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.402682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e0eca-ef46-4229-98f8-d6e1b2bbf7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.403354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e0eca-ef46-4229-98f8-d6e1b2bbf7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.403638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e0eca-ef46-4229-98f8-d6e1b2bbf7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.403910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e0eca-ef46-4229-98f8-d6e1b2bbf7f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.407990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a7db-4fdc-461d-839e-984574f30793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.408897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a7db-4fdc-461d-839e-984574f30793 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.409357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a7db-4fdc-461d-839e-984574f30793 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.409815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a7db-4fdc-461d-839e-984574f30793 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.410707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a7db-4fdc-461d-839e-984574f30793 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:39.411180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a7db-4fdc-461d-839e-984574f30793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.412911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e0eca-ef46-4229-98f8-d6e1b2bbf7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.413056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a7db-4fdc-461d-839e-984574f30793 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.415486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e0eca-ef46-4229-98f8-d6e1b2bbf7f2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.423392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 319/630] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:39.424796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c845b-78dc-4a97-a05f-d1b87b5faca9 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.425090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c845b-78dc-4a97-a05f-d1b87b5faca9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.425371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c845b-78dc-4a97-a05f-d1b87b5faca9 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.431690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 320/631] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-404e0eca-ef46-4229-98f8-d6e1b2bbf7f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:39.432479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:39.433580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:39.434813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:39.435479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c845b-78dc-4a97-a05f-d1b87b5faca9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.437189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 312/632] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:39.443233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598b059-0d14-478d-80f2-c7e4ab4c17c5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.443447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598b059-0d14-478d-80f2-c7e4ab4c17c5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.443724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598b059-0d14-478d-80f2-c7e4ab4c17c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.464616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5598b059-0d14-478d-80f2-c7e4ab4c17c5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:39.465994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5598b059-0d14-478d-80f2-c7e4ab4c17c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:39.502882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:39.523658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:39.561148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 313/633] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:39.566699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598b059-0d14-478d-80f2-c7e4ab4c17c5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.567700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c845b-78dc-4a97-a05f-d1b87b5faca9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.615950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.616592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.617407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.617685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.629639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.631148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:39.646264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:39.647203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:39.649047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:39.649047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:39.649047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:39.649047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:39.649047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 321/634] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:39.649047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.719904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598b059-0d14-478d-80f2-c7e4ab4c17c5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.763604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ebd5-00cf-4b2a-a5a3-6245c327ef9f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.771867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.772496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.772776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.773078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.774445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:39.775227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.776372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.792910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:39.794707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 314/635] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:39.795438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.813221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.814294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.814970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.815786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.821843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:39.832248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:39.840371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:39.848397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 322/636] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:39.850121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:39.922901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbb197-833f-4852-b7a6-387564ece4c5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.973420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:39.974895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:39.975178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:39.975452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:39.976170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:39.976477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:39.977979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:39.988470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be596ed-554d-460c-9594-68d3efbb91a8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:39.990055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 315/637] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:39.990703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.034436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.035450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.035941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.036425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.082385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.091402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.102575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1091-693f-4289-9a6a-599e4b62468c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.113116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.114829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.140253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.141111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.141225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.141473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.142242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:40.142581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.144051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.158014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 316/638] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:40.158943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.231591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 323/639] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:40.232878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.268131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23aa95-e849-4a5b-bdd0-17fabf3d47b8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.303662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.304820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.305141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.305438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.313442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.314941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.322690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:40.327475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:40.328430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 317/640] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:40.329808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.337882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.346997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097eb1f-915d-4b24-a105-69a09e83ff86 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.384638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad94bb-7c1a-4df6-8116-9019d6bf283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.385292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad94bb-7c1a-4df6-8116-9019d6bf283e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.385585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad94bb-7c1a-4df6-8116-9019d6bf283e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.385900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad94bb-7c1a-4df6-8116-9019d6bf283e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.396216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad94bb-7c1a-4df6-8116-9019d6bf283e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.397664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad94bb-7c1a-4df6-8116-9019d6bf283e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4cad94bb-7c1a-4df6-8116-9019d6bf283e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:40.413003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:40.414896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:40.415987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:40.415987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:40.415987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:40.415987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:40.415987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 324/641] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:40.416432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd39592-78c2-449c-813a-94b041460897 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.416727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd39592-78c2-449c-813a-94b041460897 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.417010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd39592-78c2-449c-813a-94b041460897 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.418756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 325/642] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:40.419606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd39592-78c2-449c-813a-94b041460897 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.452182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993e68-42e5-408b-ae6d-6acdfa0a2147 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.489203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e25ee-10dc-4d93-a5be-0a2a12eff87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.490197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e25ee-10dc-4d93-a5be-0a2a12eff87e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.490623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e25ee-10dc-4d93-a5be-0a2a12eff87e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.491046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e25ee-10dc-4d93-a5be-0a2a12eff87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.502799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e25ee-10dc-4d93-a5be-0a2a12eff87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.504580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e25ee-10dc-4d93-a5be-0a2a12eff87e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bb8e25ee-10dc-4d93-a5be-0a2a12eff87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:40.520314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:40.521239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:40.522599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:40.522599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:40.522599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:40.522599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:40.522599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 318/643] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:40.522959 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342712-50de-4e20-9572-8e29d9fd2e77 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.523061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342712-50de-4e20-9572-8e29d9fd2e77 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.523961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342712-50de-4e20-9572-8e29d9fd2e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.535450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd39592-78c2-449c-813a-94b041460897 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.542178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-95342712-50de-4e20-9572-8e29d9fd2e77 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:40.543505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-95342712-50de-4e20-9572-8e29d9fd2e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:40.567541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.574137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.574870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.575232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.575577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.576437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:40.576871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.578402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.601509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 326/644] 10.222.0.71 () {56 vars in 1137 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:40.601509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.610185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.628185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 319/645] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:40.629088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95342712-50de-4e20-9572-8e29d9fd2e77 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.718373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f58df-43ce-4bb9-bd04-bc65ae77f1c1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.741346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95342712-50de-4e20-9572-8e29d9fd2e77 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.755398 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.756347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.757091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.758056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.758858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:40.759267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.760798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.772064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 327/646] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:40.772928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.783215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.784139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.784631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.785148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.786050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:40.786635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:40.788187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:40.801138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 320/647] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:40.802302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:40.829330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.853815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:40.894936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f902b90-da60-455c-8b45-4794bc64fae5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.909398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f20ce-1ea4-4000-9636-6b34973268b3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:40.932408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.933169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.933559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.933956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.945782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:40.946433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:40.946721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:40.947003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:40.958551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:40.964611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:40.969787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 321/648] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:40.970945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.017179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.018594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.075521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.077503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862fc29-18ec-4e34-8888-b6d9e5900527 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.086291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.114421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.115228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.115600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.115944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.123344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.124910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.139136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 328/649] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:41.139136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:41.139391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:41.140280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 322/650] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:41.141293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.250400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e97cb-1e8b-4be4-bbd2-f7c85aa843f5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.257237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c04ae8-01b9-46d8-8a3e-fb9e69953985 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.286515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.287150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.287440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.287725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.288449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:41.289392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.290821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.293796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.294676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.295178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.295646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.299018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 323/651] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:41.299829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.303199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.305212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:41.321450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:41.322616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 329/652] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:41.328365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.333201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.340623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.404897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679892d-2f6a-4f75-978b-b6279f1a1de7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.428568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd867a-e470-4e72-a7e0-6ff1637e5eff None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.438291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.438925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.439210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.439495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.450850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.452310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.462722 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.463329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.463610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.463887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.464669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:41.464975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.466418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:41.466524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:41.467563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:41.468483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:41.468483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:41.468483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:41.468483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:41.468483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 324/653] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:41.468786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.489634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 330/654] 10.222.0.71 () {56 vars in 1137 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:41.490428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.557863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.558523 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.576987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc283-bfd5-4258-9302-07f671d222dc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.590654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d0194-5b94-4b7d-8daa-10a7a0f7d00c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.611153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a466e-d508-49fb-8692-e85eacf8103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.611795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a466e-d508-49fb-8692-e85eacf8103e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.612074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a466e-d508-49fb-8692-e85eacf8103e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.612350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a466e-d508-49fb-8692-e85eacf8103e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.623298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a466e-d508-49fb-8692-e85eacf8103e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.624763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a466e-d508-49fb-8692-e85eacf8103e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.625788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.626425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.626701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.626970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.627708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:41.628004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.629403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bf8a466e-d508-49fb-8692-e85eacf8103e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:41.639416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:41.640303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:41.641220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:41.641220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:41.641220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:41.641220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:41.641220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 325/655] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:41.642001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 331/656] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:41.642531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.646124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b35da-0bf0-487c-b5e1-cec4a64941ad None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.647031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b35da-0bf0-487c-b5e1-cec4a64941ad None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.647325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b35da-0bf0-487c-b5e1-cec4a64941ad None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.649210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 326/657] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:41.650107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b35da-0bf0-487c-b5e1-cec4a64941ad None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.742297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147a5f-cf08-406e-b7ff-753292406581 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.752047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b35da-0bf0-487c-b5e1-cec4a64941ad None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.767530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.775664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.776831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.776831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.776831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.777463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:41.777793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.779150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.781385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:41.785977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d04ba-3e19-4e19-9d8a-f95940d64349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.786580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d04ba-3e19-4e19-9d8a-f95940d64349 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.786859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d04ba-3e19-4e19-9d8a-f95940d64349 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.787133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d04ba-3e19-4e19-9d8a-f95940d64349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.791758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 332/658] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:41.792632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.870001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d04ba-3e19-4e19-9d8a-f95940d64349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.871230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d04ba-3e19-4e19-9d8a-f95940d64349 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.901094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f630a-8890-48b9-8639-0058689bce4a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:41.936331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:41.936948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.937237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.937514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.938235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:41.938542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:41.939926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:41.951650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 333/659] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:41.952441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:41.972122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 327/660] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:41.973369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3342b0-fb3d-44a4-b6df-c624a5d5dfdb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:41.973655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3342b0-fb3d-44a4-b6df-c624a5d5dfdb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:41.973964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3342b0-fb3d-44a4-b6df-c624a5d5dfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:41.991579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-da3342b0-fb3d-44a4-b6df-c624a5d5dfdb None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:41.992923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-da3342b0-fb3d-44a4-b6df-c624a5d5dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:42.006365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.018439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.058210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d987-803b-4c02-bffd-dc91b25931d3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.058998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 328/661] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:42.059821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3342b0-fb3d-44a4-b6df-c624a5d5dfdb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.094975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.096263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.096263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.096263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.096879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8771927999ea4471a4673dead83336e5) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:42.097183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.098636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.104943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 334/662] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:41 2022] GET /identity/v3/role_assignments?user.id=8771927999ea4471a4673dead83336e5&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:42.105709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.198149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3342b0-fb3d-44a4-b6df-c624a5d5dfdb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.223724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bb16-88dc-4722-b6a2-1b0845f4d196 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.237806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.238467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.238919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.239843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.240207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.248766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.250330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.262154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.263289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.263289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:42.263458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:42.264279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:42.265249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:42.265695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.266553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 329/663] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:42.266553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.275974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.277431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:42.291074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:42.292241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:42.293541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 335/664] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:42.297781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.299107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.382862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd31cd-1a09-42c6-ab9a-c46f97b4efcc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.415640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2a60b-132f-4058-a7b4-6c586f7b4cd4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.419020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.419771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.420158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.420538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.431559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.433158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:42.448259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:42.449337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:42.450495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:42.450495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:42.450495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:42.450495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:42.451385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 330/665] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:42.452059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.459347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.459993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.460278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.461568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.474231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:42.482395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:42.483395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 336/666] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:42.492459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.524245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.537258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.562899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aeb4c-030a-4b6a-86c0-b1969febc135 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.597751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8712408-4571-4849-9bb9-aabb31a57e9f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.598751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.599707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.599985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.600265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.601010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:42.601544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.603116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.615118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 331/667] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:42.615927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.641201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.641839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.642120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.642391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.643183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:42.643488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.644902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.667764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 337/668] 10.222.0.71 () {56 vars in 1139 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:42.667764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.734341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d17bd5-1d8f-444c-acf5-fb8b46642e06 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.765318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.772337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.773042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.773970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.779780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.779780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:42.779780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.779780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.780136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66ccc6-f301-4ad8-a5e2-5572e8761d9a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.780220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:42.796250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 332/669] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:42.797100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.821293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.822273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.822754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.823035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.823809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:42.824068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.825435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.834473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 338/670] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:42.835368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:42.909234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad629801-a917-46ac-b346-5ec15cb63cd2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.946095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:42.946717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:42.946997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:42.947274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:42.948068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=06a2008ab3a2497eba5e8394277c2316) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:42.948378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:42.949707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc7cca-aa47-491c-ac1a-295c701a27f7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:42.949841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:42.965748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 333/671] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/role_assignments?user.id=06a2008ab3a2497eba5e8394277c2316&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:42.965748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.002161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.003312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.003671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.004275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.036207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.038243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.088777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d042f-4f67-4b64-a4b2-fa50c966485f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.091944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.093565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.128954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.129740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.130100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.130449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.138822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.140381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:43.155531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:43.156658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:43.157906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 334/672] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:43.158403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.235569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 339/673] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:43.236693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.285219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4439d1-5e35-4db6-95ad-db8655a84dc5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.298387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.311091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.333410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.334501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.334863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.335207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.349235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.351762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.354377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b0583-f88a-4fae-946c-2d2d72b4e18d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:43.371940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:43.373012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:43.374160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:43.374160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:43.374160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:43.374160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:43.375606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 335/674] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:43.376852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.399266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.400232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.400742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.401199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.402133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:43.402585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.404431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.418147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 340/675] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:43.419228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.488401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ccd9-3ab2-4d2d-8727-b29f41a7800a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.524295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.524940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.525223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.525507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.527237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34640d6-2986-4dbd-9507-3b8d69faba94 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.536849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.538283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.542450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:43.553818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:43.555208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:43.579280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:43.579280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:43.579280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:43.579280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:43.579280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 336/676] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:43.579280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.579701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.579701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.579701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.579701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.580026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:43.580026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.580026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.594950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 341/677] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:43.595695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.596086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.691496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494615f-2ea2-42ac-8189-c2422ad90481 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.722015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f19166-34a7-48ee-b19f-88bd79f2291a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.728358 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.729165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.729595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.730068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.731534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=71adb0143db64ca68f9c3846951adb30) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:43.732013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.734148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.742664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 337/678] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/role_assignments?user.id=71adb0143db64ca68f9c3846951adb30&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:43.744245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.765876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.766647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.767417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.767803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:43.768938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:43.769361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:43.771432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:43.789839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 342/679] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:43.802004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:43.870915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.954888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:43.956639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52f84c-c750-4f1f-8870-5051a0b239fc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.978353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8efcc-fd36-4634-a713-35ea5793719c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:43.994493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:43.995142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:43.995421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:43.995703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.004127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:44.005758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:44.017432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:44.018323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.018750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:44.019168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:44.020226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:44.021353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:44.022602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.025702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 343/680] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:44.026886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:44.034153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:44.035796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:44.047949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:44.049173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:44.050282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:44.052409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 338/681] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:44.058319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:44.133568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:44.143441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c0d99-82c4-402e-a87c-ccd4a691d2a0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:44.171794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453dcd2-ff88-43c1-8394-aab1b7941f6c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:44.182501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:44.182982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.183267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.183545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.184333 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:44.184796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:44.186274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:44.205197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 344/682] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:44.206594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:44.213226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:44.214149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.214594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.215031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.216034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:44.216483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:44.218154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:44.240979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 339/683] 10.222.0.71 () {56 vars in 1135 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:44.246599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:44.252308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:44.326142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2c8a-f3e0-4e37-9b1e-a1ebd102a310 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:44.365569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed347881-1e90-459e-b3fb-8d02cbe9f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:44.366226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed347881-1e90-459e-b3fb-8d02cbe9f419 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.366515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed347881-1e90-459e-b3fb-8d02cbe9f419 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.367401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed347881-1e90-459e-b3fb-8d02cbe9f419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.368204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed347881-1e90-459e-b3fb-8d02cbe9f419 None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8f8fdc63709648dfbefb06f1b2db7ac0) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:44.368524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed347881-1e90-459e-b3fb-8d02cbe9f419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:44.369991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed347881-1e90-459e-b3fb-8d02cbe9f419 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:44.377442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 345/684] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/role_assignments?user.id=8f8fdc63709648dfbefb06f1b2db7ac0&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:44.407880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0e8d-237a-48db-a916-c150ef8257ed None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.408342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0e8d-237a-48db-a916-c150ef8257ed None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.408729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0e8d-237a-48db-a916-c150ef8257ed None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.410737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 346/685] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:44.419423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e9b06-a0a7-4827-bf64-fbe77e007939 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.419889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e9b06-a0a7-4827-bf64-fbe77e007939 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.420276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e9b06-a0a7-4827-bf64-fbe77e007939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.442018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-960e9b06-a0a7-4827-bf64-fbe77e007939 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:44.444100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-960e9b06-a0a7-4827-bf64-fbe77e007939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:44.459883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:44.504087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39df98-64a4-41e6-884d-43908d334bb0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:44.531823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 347/686] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:44.563412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e9b06-a0a7-4827-bf64-fbe77e007939 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:44.577786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:44.578540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.578904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.579241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.661568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:44.663246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:44.667057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:44.675466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e9b06-a0a7-4827-bf64-fbe77e007939 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:44.716811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:44.717686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.718075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.718419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.730447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:44.736988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:44.738138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:44.739198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:44.740484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 348/687] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:44.746495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:44.758786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:44.798552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 340/688] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:44.806297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:44.869680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15371-b82a-4900-9f50-4994924fb4a3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:44.943580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec73933-e4cb-457c-a630-b87123014677 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:44.948237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:44.948944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:44.949501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:44.950582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:44.951618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:44.952432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:44.956590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:44.958221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:44.973013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 349/689] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:44.979859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.015411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.016908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.017315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.017690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.031698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.033314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:45.054471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:45.055622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:45.056643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:45.056643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:45.056643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:45.056643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:45.058380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 341/690] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:45.066747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.112478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:45.157919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f243e8-78dd-4fef-8b7d-737ce5f05957 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:45.196858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.197518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.197833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.198189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.220022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.221552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:45.251428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:45.252594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:45.253709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:45.253709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:45.253709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:45.253709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:45.253709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 350/691] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:45.260057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.380187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3c054-12f5-4800-87e4-03f3a639793c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:45.395321 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa5b9f-3896-406c-ac0d-a068ebfcecf1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:45.402697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:45.420349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fafb03-95c4-49e6-b13d-9a5a1bc1c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.420349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fafb03-95c4-49e6-b13d-9a5a1bc1c6dc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.420349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fafb03-95c4-49e6-b13d-9a5a1bc1c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.420349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fafb03-95c4-49e6-b13d-9a5a1bc1c6dc None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.420742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fafb03-95c4-49e6-b13d-9a5a1bc1c6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:45.420742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fafb03-95c4-49e6-b13d-9a5a1bc1c6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.422061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fafb03-95c4-49e6-b13d-9a5a1bc1c6dc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.433180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447a93-8a11-4268-8f5e-8388bd8f89f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.433840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447a93-8a11-4268-8f5e-8388bd8f89f1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.434123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447a93-8a11-4268-8f5e-8388bd8f89f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.434397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447a93-8a11-4268-8f5e-8388bd8f89f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.435107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447a93-8a11-4268-8f5e-8388bd8f89f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:45.435410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447a93-8a11-4268-8f5e-8388bd8f89f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.436824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447a93-8a11-4268-8f5e-8388bd8f89f1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.437801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 351/692] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:45.439218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217e33-fb37-4219-9287-cdeec48fca13 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.439512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217e33-fb37-4219-9287-cdeec48fca13 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.439791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217e33-fb37-4219-9287-cdeec48fca13 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.441458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 352/693] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:45.447439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5217e33-fb37-4219-9287-cdeec48fca13 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.459455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 342/694] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:45.460819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7dab1-3c99-4b84-8259-88bca2444af6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.461105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7dab1-3c99-4b84-8259-88bca2444af6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.461380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7dab1-3c99-4b84-8259-88bca2444af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.479892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a1e7dab1-3c99-4b84-8259-88bca2444af6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:45.481085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a1e7dab1-3c99-4b84-8259-88bca2444af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:45.493112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:45.558025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 343/695] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:45.559036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7dab1-3c99-4b84-8259-88bca2444af6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.565594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5217e33-fb37-4219-9287-cdeec48fca13 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:45.603841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.604493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.604874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.605158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.613321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.614806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:45.629084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:45.631270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 353/696] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:45.633666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.686450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7dab1-3c99-4b84-8259-88bca2444af6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:45.725084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.725771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.726104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.726380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.734147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.735697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:45.748457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:45.750727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 344/697] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:45.752829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.762751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:45.806712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:45.857468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35234-4c1c-4623-9cc4-e4ad2da7401d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:45.880371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344570ca-f070-46ce-88ae-0afce27e0ab1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:45.899819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.900543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.900845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.901097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.901937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:45.902425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.903675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.921406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:45.922316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:45.922744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:45.923164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:45.924014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:45.925557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:45.927338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 345/698] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:45.928239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:45.939342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:45.940537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:45.941543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:45.944185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 354/699] 10.222.0.71 () {56 vars in 1129 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:45.946030 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.000899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.039695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386ef0b-4123-467f-a000-5b56b1910664 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.061923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f27549-4315-4c2b-a344-a28f5e349a34 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.064724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.074658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.075279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.075559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.075837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.076722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:46.076887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.078426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.091171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 346/700] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:46.092076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.104103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.105005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.105440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.107020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.183744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.185999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.197221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749a80c-015b-45e5-8da2-cb27a98d8e92 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.221212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.232614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.233514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.233514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.234318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.234458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:46.234763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.236132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.245978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 347/701] 10.222.0.71 () {56 vars in 1124 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:46.247115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.301761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 355/702] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:46.302902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.307300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.357566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee37b3-e388-498c-bb12-ef7178be7900 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.393527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.394187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.394457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.394731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.395518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=72bd8d0e197643a58f5becd38d1ab474) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:46.395823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.397244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.404234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 348/703] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/role_assignments?user.id=72bd8d0e197643a58f5becd38d1ab474&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:46.404473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.418961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b8917-ecab-4f95-9a95-4fd33c9147d4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.457338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596121f-dc84-4b73-bb13-767c3067c662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.457922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596121f-dc84-4b73-bb13-767c3067c662 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.458209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596121f-dc84-4b73-bb13-767c3067c662 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.458485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596121f-dc84-4b73-bb13-767c3067c662 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.459175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596121f-dc84-4b73-bb13-767c3067c662 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:46.459482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596121f-dc84-4b73-bb13-767c3067c662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.460939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596121f-dc84-4b73-bb13-767c3067c662 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.473776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.473971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 356/704] 10.222.0.71 () {56 vars in 1124 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:46.476617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0201f-fbfa-4098-96c2-16ef0a86e07b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.476923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0201f-fbfa-4098-96c2-16ef0a86e07b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.477299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0201f-fbfa-4098-96c2-16ef0a86e07b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.482309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 357/705] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:46.485934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33ba53-aea9-4f76-a8e9-51088f386699 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.486325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33ba53-aea9-4f76-a8e9-51088f386699 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.486606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33ba53-aea9-4f76-a8e9-51088f386699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.523549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6d33ba53-aea9-4f76-a8e9-51088f386699 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:46.524776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6d33ba53-aea9-4f76-a8e9-51088f386699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:46.549746 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ad4fb-e568-45d9-9b08-f8c8346881f7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.604996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.613392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.613814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 358/706] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:46.617744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.617744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.617744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.627921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.629412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.642983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33ba53-aea9-4f76-a8e9-51088f386699 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:46.647591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:46.648619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:46.649546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:46.649546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:46.649546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:46.649546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:46.649846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 349/707] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:46.655383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.774825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33ba53-aea9-4f76-a8e9-51088f386699 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.798866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82877cf5-5bcf-42b3-ac54-a302161b4e23 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:46.802052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.822408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.823064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.823347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.823631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.834897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.837006 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.848092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:46.849172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:46.849899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:46.850331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:46.852409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:46.852903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:46.854462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:46.855651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:46.856723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:46.857869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:46.857869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:46.857869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:46.857869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:46.859001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 359/708] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:46.871783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.873342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 350/709] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:46.879671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:46.939890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:46.999124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecd1fc-41a9-419c-99a6-a032917e2694 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.030209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415d35b-4420-46fd-8c1c-3a7cc47323cb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.043647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134813a8-a0e2-4ef7-8997-e8b445657fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.044403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134813a8-a0e2-4ef7-8997-e8b445657fca None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.044759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134813a8-a0e2-4ef7-8997-e8b445657fca None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.045108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134813a8-a0e2-4ef7-8997-e8b445657fca None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.045896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134813a8-a0e2-4ef7-8997-e8b445657fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:47.046275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134813a8-a0e2-4ef7-8997-e8b445657fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.047709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134813a8-a0e2-4ef7-8997-e8b445657fca None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.061676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 360/710] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:47.063143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e55e6d-b549-4eb5-927c-2afab00b036c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.063533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e55e6d-b549-4eb5-927c-2afab00b036c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.063946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e55e6d-b549-4eb5-927c-2afab00b036c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.065534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 361/711] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:47.066713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e55e6d-b549-4eb5-927c-2afab00b036c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:47.076021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f806ca-2c28-48c3-bbbc-a710cd60270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.077800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f806ca-2c28-48c3-bbbc-a710cd60270b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.078236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f806ca-2c28-48c3-bbbc-a710cd60270b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.078660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f806ca-2c28-48c3-bbbc-a710cd60270b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.089166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f806ca-2c28-48c3-bbbc-a710cd60270b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.090664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f806ca-2c28-48c3-bbbc-a710cd60270b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b0f806ca-2c28-48c3-bbbc-a710cd60270b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:47.105550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:47.106539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:47.107849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 351/712] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:47.108341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adf5d-aa8c-4c5a-bbad-be9b347c30ad None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.108341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adf5d-aa8c-4c5a-bbad-be9b347c30ad None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.108463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adf5d-aa8c-4c5a-bbad-be9b347c30ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.134231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f15adf5d-aa8c-4c5a-bbad-be9b347c30ad None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:47.135441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f15adf5d-aa8c-4c5a-bbad-be9b347c30ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:47.159882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:47.221020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e55e6d-b549-4eb5-927c-2afab00b036c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.229625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 352/713] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:47.230592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15adf5d-aa8c-4c5a-bbad-be9b347c30ad None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:47.237556 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:47.277422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.278912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.279208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.279491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.280182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.281679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.351983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15adf5d-aa8c-4c5a-bbad-be9b347c30ad None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.354278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 362/714] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:03:47 2022] POST /identity/v3/users => generated 254 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:47.356107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:47.429269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.430504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.431005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.431484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.432495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:47.441745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.443848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.462058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 353/715] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:47.468223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:47.504674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:47.516247 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a8412-85b1-41fb-9089-765443e2f58a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.560235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.560844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.561174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.561368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.562035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.564290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:47.577616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:47.579084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:47.580169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 363/716] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:47 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:47.585674 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:47.626675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:47.631162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa620b-5b3e-4a72-b83b-3f215d9aa6ad None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.674377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.675267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.675755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.676242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.677238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8771927999ea4471a4673dead83336e5) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:47.678476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.681005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.687524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 354/717] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:47 2022] GET /identity/v3/role_assignments?user.id=8771927999ea4471a4673dead83336e5&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:47.714723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501dc99-7815-47d1-ad21-3b71d518c9d9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.761614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55615ff6-fafc-49a4-a6fd-73bab9fa776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.762679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55615ff6-fafc-49a4-a6fd-73bab9fa776c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.763167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55615ff6-fafc-49a4-a6fd-73bab9fa776c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.763646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55615ff6-fafc-49a4-a6fd-73bab9fa776c None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.764568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55615ff6-fafc-49a4-a6fd-73bab9fa776c None admin] RBAC: Adding query filter params (name=network) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:47.765097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55615ff6-fafc-49a4-a6fd-73bab9fa776c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.766840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55615ff6-fafc-49a4-a6fd-73bab9fa776c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.772862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 364/718] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:03:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:47.778552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:47.899460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:47.930241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58635432-f0b7-4099-b956-44241f1481ac None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:47.977008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42483a8-03c3-48b3-bc2a-25f75ccb8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:47.977641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42483a8-03c3-48b3-bc2a-25f75ccb8625 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:47.977952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42483a8-03c3-48b3-bc2a-25f75ccb8625 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:47.978229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42483a8-03c3-48b3-bc2a-25f75ccb8625 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:47.978913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42483a8-03c3-48b3-bc2a-25f75ccb8625 None admin] RBAC: Adding query filter params (type=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:47.979219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42483a8-03c3-48b3-bc2a-25f75ccb8625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:47.980602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42483a8-03c3-48b3-bc2a-25f75ccb8625 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:47.986348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 355/719] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:03:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:48.874767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a03cd-3575-4951-8d56-e293212272d6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:48.875575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a03cd-3575-4951-8d56-e293212272d6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:48.876052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a03cd-3575-4951-8d56-e293212272d6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:48.878021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 365/720] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:48.884015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8b48-f906-4dc2-b964-e82ef099df25 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:48.884442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8b48-f906-4dc2-b964-e82ef099df25 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:48.884542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8b48-f906-4dc2-b964-e82ef099df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:48.918784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-dbee8b48-f906-4dc2-b964-e82ef099df25 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:48.919994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dbee8b48-f906-4dc2-b964-e82ef099df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:48.993331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a370374-cc89-4c3a-ba02-42d742f97a74 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:48.994036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a370374-cc89-4c3a-ba02-42d742f97a74 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:48.994551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a370374-cc89-4c3a-ba02-42d742f97a74 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:48.997387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 366/721] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:49.002010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e720da-a07c-4515-a7c4-2a04bb90b3c2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:49.002291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e720da-a07c-4515-a7c4-2a04bb90b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:49.002570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e720da-a07c-4515-a7c4-2a04bb90b3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.020783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 356/722] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:49.027520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-89e720da-a07c-4515-a7c4-2a04bb90b3c2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:49.028784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-89e720da-a07c-4515-a7c4-2a04bb90b3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:49.052281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8b48-f906-4dc2-b964-e82ef099df25 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:49.156646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 367/723] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:49.184068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:49.216745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8b48-f906-4dc2-b964-e82ef099df25 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:49.253105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e720da-a07c-4515-a7c4-2a04bb90b3c2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:49.259768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:49.260406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:49.260691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:49.260967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.261667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:49.263263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:49.298138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:49.378292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e720da-a07c-4515-a7c4-2a04bb90b3c2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:49.388882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 357/724] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:03:49 2022] POST /identity/v3/services => generated 251 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:03:49.434122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:49.434772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:49.435051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:49.435320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.448624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:49.453824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:49.454827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:49.455696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 368/725] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:49.463117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:49.602320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105078-2df2-4a9f-9c89-db7ed5b32513 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:49.636100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:49.641171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:49.641894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:49.642190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:49.642472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.643210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:49.643514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:49.644918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:49.655199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 358/726] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:49.661226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:49.778526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:49.813199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1497c-4f64-47b6-a397-5b1a610b8e0c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:49.873110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb03e15-691e-4cb5-bbb7-000fc0dd6d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:49.873110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03e15-691e-4cb5-bbb7-000fc0dd6d67 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:49.873110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03e15-691e-4cb5-bbb7-000fc0dd6d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:49.873110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03e15-691e-4cb5-bbb7-000fc0dd6d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:49.892355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb03e15-691e-4cb5-bbb7-000fc0dd6d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:49.893925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb03e15-691e-4cb5-bbb7-000fc0dd6d67 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-feb03e15-691e-4cb5-bbb7-000fc0dd6d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:49.911902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:49.912865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:49.914781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:49.914781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:49.914781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:49.914781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:49.914781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 369/727] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:49.921265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.075583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6803e-2997-4d11-8821-8903d91c7972 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:50.076123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f48c6b-c024-4fa5-b986-4867772da502 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.076596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f48c6b-c024-4fa5-b986-4867772da502 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.077097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f48c6b-c024-4fa5-b986-4867772da502 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.079484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 370/728] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:50.086324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c7ff-f321-4352-9fc8-cd13e0708523 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.094182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c7ff-f321-4352-9fc8-cd13e0708523 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.094478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c7ff-f321-4352-9fc8-cd13e0708523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.118770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1aa9c7ff-f321-4352-9fc8-cd13e0708523 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:50.119985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1aa9c7ff-f321-4352-9fc8-cd13e0708523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:50.154064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:50.154693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.154972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.155263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.156054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:50.156360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:50.157752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:50.185066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 359/729] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:50.190671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.262078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:50.263602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 371/730] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:03:50.270997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69cbc-5ef8-486e-b954-fe820d7d8d46 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.282182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69cbc-5ef8-486e-b954-fe820d7d8d46 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.282182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69cbc-5ef8-486e-b954-fe820d7d8d46 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.282182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 372/731] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:50.282182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200aba-49df-4b04-9954-631388b25b4b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.282182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200aba-49df-4b04-9954-631388b25b4b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.282182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200aba-49df-4b04-9954-631388b25b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.316334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab68d91-6905-4a6d-ac2a-bea59aa971e7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:50.326648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9e200aba-49df-4b04-9954-631388b25b4b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:50.328438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9e200aba-49df-4b04-9954-631388b25b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:50.359580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:50.360286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.360633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.360992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.371234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:50.372894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:50.386695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:50.387722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 360/732] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:50.389838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.402934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:50.414259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 373/733] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:50.415183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200aba-49df-4b04-9954-631388b25b4b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.521610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200aba-49df-4b04-9954-631388b25b4b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:50.533589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d7b65-c232-4b0f-b507-9bb843bb91a3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:50.548862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:50.559928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:50.561432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.561432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.561710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.562557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:50.563179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:50.565271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:50.572651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:50.573386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.573763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.574116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.587440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:50.587925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 374/734] 10.222.0.71 () {56 vars in 1135 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:50.588866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:50.593875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:50.595868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 361/735] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:50.598122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.666758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:50.714603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3114e1-7e93-428f-8282-4095de274480 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:50.730653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96964a-ca16-4c65-81bc-911564035fbc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:50.751762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:50.752830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.753115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.753528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.768152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:50.768787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.769067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.769342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.780234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:50.785354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:50.786529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:50.787462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 375/736] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:50.788153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.803855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:50.831267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:50.832749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:50.911646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc84ce-7898-49dc-8fcc-f25534ea0326 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:50.923476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:50.948844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc5dd7-80c8-4e89-9a35-8da85037eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:50.949494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5dd7-80c8-4e89-9a35-8da85037eba9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.949750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5dd7-80c8-4e89-9a35-8da85037eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.950038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5dd7-80c8-4e89-9a35-8da85037eba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.950746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5dd7-80c8-4e89-9a35-8da85037eba9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:50.951251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5dd7-80c8-4e89-9a35-8da85037eba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:50.952650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5dd7-80c8-4e89-9a35-8da85037eba9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:50.961468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 376/737] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:50.966210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 362/738] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:50.966955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082736d-80d9-4cd5-bea7-a3c53e01fbf8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:50.967087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:50.967759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082736d-80d9-4cd5-bea7-a3c53e01fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:50.968391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082736d-80d9-4cd5-bea7-a3c53e01fbf8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:50.971145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 377/739] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:50.971145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082736d-80d9-4cd5-bea7-a3c53e01fbf8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.050405 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.078152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082736d-80d9-4cd5-bea7-a3c53e01fbf8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.078367 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f4e58-706b-4c11-b793-628b4dcb981e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.115515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3167e49-6adb-4d45-a808-e32ef90aa77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.116151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167e49-6adb-4d45-a808-e32ef90aa77f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.116447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167e49-6adb-4d45-a808-e32ef90aa77f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.117297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167e49-6adb-4d45-a808-e32ef90aa77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.117667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.118331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.118616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.118896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.119673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:51.119928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.121347 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.128853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3167e49-6adb-4d45-a808-e32ef90aa77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.134957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 363/740] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:51.135094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3167e49-6adb-4d45-a808-e32ef90aa77f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.135172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c3167e49-6adb-4d45-a808-e32ef90aa77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:51.152311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:51.153306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:51.154261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:51.154261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:51.154261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:51.154261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:51.154261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 378/741] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:51.155101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693da4-dff7-475a-92ce-21bf39558492 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.155385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693da4-dff7-475a-92ce-21bf39558492 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.155662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693da4-dff7-475a-92ce-21bf39558492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.174834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-eb693da4-dff7-475a-92ce-21bf39558492 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:51.176105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eb693da4-dff7-475a-92ce-21bf39558492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:51.195246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.246313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781cfa8-8e77-435c-8e0b-e0d640c49b77 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.248558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 379/742] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:03:51.254581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693da4-dff7-475a-92ce-21bf39558492 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.285658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.286424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.286619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.286896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.290339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.299252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.300704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:51.315258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:51.316227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:51.317141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:51.317141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:51.317141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:51.317141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:51.321751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 364/743] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:51.322582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.365665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693da4-dff7-475a-92ce-21bf39558492 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.402477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.403038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.403326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.403598 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.414115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.415568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.427084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18832b-32a9-4547-8292-ec63e791e05b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:51.431797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:51.432680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:51.433565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:51.433565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:51.433565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:51.433565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:51.437698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 380/744] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:51.438555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.448419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.466066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.466737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.466976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.467255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.467951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:51.468329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.469705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.486664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 365/745] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:51.486664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.541277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.551046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cf38d-589a-42fe-9724-8f480bc8ed31 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.587566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.588273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.588602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.588886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.589803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.591305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.595228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040ff06-2b13-40aa-8279-820770adf666 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.631041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.631666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.631950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.632866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.633598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:51.633946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.635320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.646537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 366/746] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:51.651348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.667763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 381/747] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:03:51 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:51.668818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.762513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.786126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89431378-7586-46f4-bfb0-aae06206776f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.797048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:51.810106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89dcf-1aa1-4ec7-88ab-39c532caf7dc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:51.826630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.827267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.827552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.827830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.828542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:51.828848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.830615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.845837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 367/748] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:51.846711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:51.848992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:51.850148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:51.850579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:51.851694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:51.860426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:51.862837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:51.885056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:51.886264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 382/749] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:51.887827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.030749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9f156-8291-4a4f-930e-99f580c4d097 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.062734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db79b-4673-4631-88e6-09c3ce4a664d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.068970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.069662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.069978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.070253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.077998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.080833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.088094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:52.091969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:52.093278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:52.094831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:52.098042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 368/750] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:52.098904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.103991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17555e-0301-455d-b3d4-23ff219dca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.104648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17555e-0301-455d-b3d4-23ff219dca3e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.104924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17555e-0301-455d-b3d4-23ff219dca3e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.105194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17555e-0301-455d-b3d4-23ff219dca3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.113742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17555e-0301-455d-b3d4-23ff219dca3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.115435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17555e-0301-455d-b3d4-23ff219dca3e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4d17555e-0301-455d-b3d4-23ff219dca3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:52.128176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:52.129108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:52.130110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 383/751] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:03:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:52.131338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06b4b-1b80-4de1-a885-544fe53cdcd5 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.131338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06b4b-1b80-4de1-a885-544fe53cdcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.131338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06b4b-1b80-4de1-a885-544fe53cdcd5 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.132925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 384/752] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:52.135254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.137518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e06b4b-1b80-4de1-a885-544fe53cdcd5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.215862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fdd76-8d10-462d-8244-6513c9390abe None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.251140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e06b4b-1b80-4de1-a885-544fe53cdcd5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.255293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.256024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.256424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.256795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.258357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:52.258763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.260300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.278498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 369/753] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:52.283694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.288478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927f14e-296c-40b4-84b3-3259078bf3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.289525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f14e-296c-40b4-84b3-3259078bf3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.290002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f14e-296c-40b4-84b3-3259078bf3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.290285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f14e-296c-40b4-84b3-3259078bf3c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.291032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927f14e-296c-40b4-84b3-3259078bf3c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:52.291338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927f14e-296c-40b4-84b3-3259078bf3c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.293010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927f14e-296c-40b4-84b3-3259078bf3c9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.311591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 385/754] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:52.312639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced74e18-ee2d-4059-a14b-22e36e2f99af None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.312928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced74e18-ee2d-4059-a14b-22e36e2f99af None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.313204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced74e18-ee2d-4059-a14b-22e36e2f99af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.331555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ced74e18-ee2d-4059-a14b-22e36e2f99af None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:52.332729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ced74e18-ee2d-4059-a14b-22e36e2f99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:52.371808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.375759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.391330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff9d3f-2a38-4252-9483-c66d95bab6a9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.404836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 386/755] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:03:52.406327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced74e18-ee2d-4059-a14b-22e36e2f99af None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.434556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.435282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.435561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.435831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.436756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:52.437060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.438636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.463207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 370/756] 10.222.0.71 () {56 vars in 1149 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:52.463207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.528708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced74e18-ee2d-4059-a14b-22e36e2f99af None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.565970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.566531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.566814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.567090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.567947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83271f-d44a-4f64-b561-5fce565dc017 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.577952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.579388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:52.594936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:52.596069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:52.597498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:52.597498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:52.597498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:52.597498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:52.597498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 387/757] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:52.597498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.612200 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.612962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.613183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.613458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.614382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=72bd8d0e197643a58f5becd38d1ab474) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:52.614680 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.616171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.623537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 371/758] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/role_assignments?user.id=72bd8d0e197643a58f5becd38d1ab474&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:52.624321 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.635499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.644224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.722313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8e80-234a-4fd3-bbe6-b3bd70285e43 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.755304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9deb199-3e69-4493-a67e-f3dc767cd8fa None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.767245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.767464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.767743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.768027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.768668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.770128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:52.781484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:52.782516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:52.783336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:52.787915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 388/759] 10.222.0.71 () {56 vars in 1129 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:52.789429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:52.811201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.812302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.812676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.813029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.906058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.906273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.907718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.918818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:52.921413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294cde-086c-4add-9d48-d45a37302a83 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:52.958471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:52.959906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:52.960867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:52.961290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:52.962177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:52.962624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:52.964141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:52.982112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 389/760] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:52.983218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.017841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 372/761] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:53.018738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.096597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af2cca-4716-4ba2-b134-fdd431452f6a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.124792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c0d82-b7bf-49c3-86a9-00bc4775b5ea None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.134793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:53.136855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.137644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.138218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.138640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.139553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:53.140004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.141517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.151652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 390/762] 10.222.0.71 () {56 vars in 1124 bytes} [Tue Aug 2 09:03:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:53.152744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.161041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.161689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.161995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.162268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.170489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:53.171413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.172867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:53.187759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:53.188912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:53.190206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:53.193974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 373/763] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:53.195485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.269916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67d31a-b90c-4e5e-9aa9-a59fa9960233 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.306103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.307031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.307461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.307880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.315024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d1a61-bb62-4738-b2f7-651c0af0fafc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.320479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.322172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:53.339049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:53.340190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:53.341133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:53.341133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:53.341133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:53.341133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:53.347328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 391/764] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:53.348405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.353943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.354494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.354785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.355067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.355803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:53.356115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.357496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.362904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 374/765] 10.222.0.71 () {56 vars in 1124 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:53.363689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.397430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:53.422188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:53.465106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158d67-ca56-4550-9c41-813acd0dafa0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.473303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f800-cd95-4d87-a3b8-a50be916fe4f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.504542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.505426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.505992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.506413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.507430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:53.507880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.509585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.511882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.512603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.512885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.513162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.513909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:53.514218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.515580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.524933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 392/766] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:53.525970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.532925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 375/767] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:53.535438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.648545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:53.656991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca885ba4-ba08-4563-97b2-93f4059efee1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.660872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7af5-5efe-48e6-abc6-d220f5c5317b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.688714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:53.697504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.698369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.698849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.699273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.705858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.705858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.705858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.705858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.706224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] RBAC: Adding query filter params (interface=public, service_id=dd3fa62e68014b2d9a7e2694daebd5f5, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:53.706224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.706787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.707407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.709107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.716047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 393/768] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/endpoints?service_id=dd3fa62e68014b2d9a7e2694daebd5f5&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:53.716716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:53.723504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:53.724881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:53.726121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:53.732691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 376/769] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:53.733700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.853482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb02bf-411b-48a8-b036-f8c6d87bb5dd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.859968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3a29a-b069-4a37-9bda-78338c9bdc1c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:53.909650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e565c3-748a-45a2-a2e9-e1648e6bbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.910325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e565c3-748a-45a2-a2e9-e1648e6bbb66 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.910669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e565c3-748a-45a2-a2e9-e1648e6bbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.910970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e565c3-748a-45a2-a2e9-e1648e6bbb66 None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8771927999ea4471a4673dead83336e5/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.912291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:53.913020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e565c3-748a-45a2-a2e9-e1648e6bbb66 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=8771927999ea4471a4673dead83336e5, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.913284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:53.914334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:53.914860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:53.915389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e565c3-748a-45a2-a2e9-e1648e6bbb66 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.915833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:53.917577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:53.924185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 377/770] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:53.925804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:53.958585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:54.009594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 394/771] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:03:53 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8771927999ea4471a4673dead83336e5/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:54.011165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842ade-af22-494e-9c96-42a405f2e99f None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.011555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842ade-af22-494e-9c96-42a405f2e99f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.011841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842ade-af22-494e-9c96-42a405f2e99f None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.019795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 395/772] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:54.021273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1a0a-5681-4117-9c7b-25e20a38acce None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.025744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1a0a-5681-4117-9c7b-25e20a38acce None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.025744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1a0a-5681-4117-9c7b-25e20a38acce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.071638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5b7d1a0a-5681-4117-9c7b-25e20a38acce None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:54.072894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5b7d1a0a-5681-4117-9c7b-25e20a38acce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:54.114914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037237a-3e53-4eea-8dfe-036148525624 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:54.166262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:54.188206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 396/773] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:03:54.200922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:54.202287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.202717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.203165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.204084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:54.204537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:54.206176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:54.220078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 378/774] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:54.226824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1a0a-5681-4117-9c7b-25e20a38acce None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:54.237129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:54.384536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1a0a-5681-4117-9c7b-25e20a38acce None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:54.384761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:54.415330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557533b-c957-40f0-847b-59f1bc25e1be None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:54.433130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:54.434047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.434572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.434999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.435989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=15a779d5df5c4df3bac4ef4fa47c5948) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:54.436476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:54.438185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:54.445987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 397/775] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:03:54 2022] GET /identity/v3/role_assignments?user.id=15a779d5df5c4df3bac4ef4fa47c5948&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:54.471352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:54.472027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.472317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.472594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] PATH_INFO: `/v3/services/network` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.473228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:54.474896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:54.489887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:54.491185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:54.492927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 379/776] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:54 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:54.500111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:54.566787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:54.635263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac0b47-823e-4217-ba4a-8b5a7ee8599e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:54.671647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147994d4-2130-4b9b-8809-6ffc0bb4f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:54.672521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147994d4-2130-4b9b-8809-6ffc0bb4f7ed None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.672955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147994d4-2130-4b9b-8809-6ffc0bb4f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.673382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147994d4-2130-4b9b-8809-6ffc0bb4f7ed None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.674261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147994d4-2130-4b9b-8809-6ffc0bb4f7ed None admin] RBAC: Adding query filter params (name=network) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:54.674715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147994d4-2130-4b9b-8809-6ffc0bb4f7ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:54.676232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147994d4-2130-4b9b-8809-6ffc0bb4f7ed None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:54.682486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 398/777] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:03:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:54.688419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:54.840690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c700ad7-d3de-49e5-b6b5-305abef8108b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:54.840879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56ffd-fa07-4063-bed2-73b34badc3d4 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.841089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56ffd-fa07-4063-bed2-73b34badc3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.846359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56ffd-fa07-4063-bed2-73b34badc3d4 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.846359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 399/778] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:54.848720 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece44d1-5f36-4e31-bf14-bca7529a9ba5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.849213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece44d1-5f36-4e31-bf14-bca7529a9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.849958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece44d1-5f36-4e31-bf14-bca7529a9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.874289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8ece44d1-5f36-4e31-bf14-bca7529a9ba5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:54.882648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8ece44d1-5f36-4e31-bf14-bca7529a9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:54.915988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:54.916724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:54.916993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:54.917155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:54.922044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:54.924372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:54.924372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:54.936132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 380/779] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:03:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:54.946591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:54.951762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:55.013837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 400/780] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:03:55.067096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece44d1-5f36-4e31-bf14-bca7529a9ba5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:55.111769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:55.120822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214fbb6-a9c0-4674-9153-0286415fedf3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:55.172598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:55.173291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:55.173576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:55.173873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:55.174754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] RBAC: Adding query filter params (interface=public, service_id=b1b6408397704ee688c38ff423c5bba7, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:55.175171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:55.176557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:55.196149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 381/781] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:03:54 2022] GET /identity/v3/endpoints?service_id=b1b6408397704ee688c38ff423c5bba7&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:55.201285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:55.206586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece44d1-5f36-4e31-bf14-bca7529a9ba5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:55.243013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:55.243829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:55.244111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:55.244384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:55.254815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:55.261314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:55.262282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:55.263318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 401/782] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:55.270326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:55.343388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:55.383463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8bbd-1141-4e6f-bb6a-637c8494630c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:55.386171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:55.419474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:55.420113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:55.420396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:55.420676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:55.421400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:55.421702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:55.423105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:55.424077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054c528-91bb-49ec-88bf-df5c966966e8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:55.433537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 402/783] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:55.439089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:55.539232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:55.539768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:55.539859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:55.540142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:55.540815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:55.542234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:55.545480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77c13-fb1f-4a0a-9235-e216f68940d4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:55.557640 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 382/784] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:03:55 2022] GET /identity/v3/services => generated 772 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:55.581913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:55.582586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:55.582874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:55.583213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:55.595436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:55.596985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:55.614506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:55.615459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:55.617582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:55.617582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:55.617582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:55.617582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:55.617582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 403/785] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:55.621857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:55.777794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80db6-80e7-438e-8bea-701b31c77442 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:55.809275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:55.815342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:55.815966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:55.816246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:55.816521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:55.818508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:55.818508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:55.818953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:55.832289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 383/786] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:55.838180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:55.856749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:55.958087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af9f-1d47-4559-8f3e-918eef0a9c65 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:56.008827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:56.009885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.010368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.010862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.025850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:56.027708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:56.046717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:56.047686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:03:56.048617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:56.056466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 404/787] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:56.061909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:56.187935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b16c1-4436-445b-b10b-5aacf9d3f85d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:56.224156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a009c-dc8a-4470-8704-5ebe87e425ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:56.225073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a009c-dc8a-4470-8704-5ebe87e425ce None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.225313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a009c-dc8a-4470-8704-5ebe87e425ce None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.225568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a009c-dc8a-4470-8704-5ebe87e425ce None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.226480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a009c-dc8a-4470-8704-5ebe87e425ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:56.226733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a009c-dc8a-4470-8704-5ebe87e425ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:56.228222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a009c-dc8a-4470-8704-5ebe87e425ce None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:56.252985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 384/788] 10.222.0.71 () {56 vars in 1135 bytes} [Tue Aug 2 09:03:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:56.259161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:56.378002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:56.426350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7a07b-2408-41de-9253-f674ff776671 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:56.443191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e9fd-3db9-4a82-9eaf-0818e33d5956 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.443591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e9fd-3db9-4a82-9eaf-0818e33d5956 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.443760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e9fd-3db9-4a82-9eaf-0818e33d5956 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.445333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 385/789] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:56.450674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f330f-8ab1-44d6-bd0d-79f36bc38080 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.451230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f330f-8ab1-44d6-bd0d-79f36bc38080 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.451604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f330f-8ab1-44d6-bd0d-79f36bc38080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.478772 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-db6f330f-8ab1-44d6-bd0d-79f36bc38080 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:56.479987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-db6f330f-8ab1-44d6-bd0d-79f36bc38080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:56.486113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:56.486759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.487044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.487327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.505284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:56.506768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:56.529435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:56.530565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:56.531939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:56.531939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:56.531939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:56.531939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:56.531939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 405/790] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:56.536154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:56.600419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:56.636300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 386/791] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:03:56.696055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037806dd-f996-46c8-88cd-6f36737b5cc3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:56.700761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f330f-8ab1-44d6-bd0d-79f36bc38080 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:56.750219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:56.772371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:56.773227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.773524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.774008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.774736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:56.775045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:56.776499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:56.796574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 406/792] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:56.801760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:56.840768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f330f-8ab1-44d6-bd0d-79f36bc38080 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:56.893860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777b37f-989a-4fcf-94e2-2f7cd7853626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:56.894872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b37f-989a-4fcf-94e2-2f7cd7853626 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.895448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b37f-989a-4fcf-94e2-2f7cd7853626 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.895930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b37f-989a-4fcf-94e2-2f7cd7853626 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.896913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777b37f-989a-4fcf-94e2-2f7cd7853626 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:56.903479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777b37f-989a-4fcf-94e2-2f7cd7853626 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3777b37f-989a-4fcf-94e2-2f7cd7853626 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:56.917404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:56.918532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:03:56.919609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:56.921301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d672c-10d4-425c-ae1b-80396853a4b4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:56.922789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 387/793] 10.222.0.71 () {56 vars in 1129 bytes} [Tue Aug 2 09:03:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:56.924379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329db4-d38f-4acb-951a-f5d9d4d18f48 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.924868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329db4-d38f-4acb-951a-f5d9d4d18f48 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.925340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329db4-d38f-4acb-951a-f5d9d4d18f48 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.927164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 388/794] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:56.929586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0329db4-d38f-4acb-951a-f5d9d4d18f48 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:56.957377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e016a-b087-48d4-ae96-3ffe9c435d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:56.958075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e016a-b087-48d4-ae96-3ffe9c435d71 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.958574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e016a-b087-48d4-ae96-3ffe9c435d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.958685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e016a-b087-48d4-ae96-3ffe9c435d71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.966132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e016a-b087-48d4-ae96-3ffe9c435d71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:56.967569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e016a-b087-48d4-ae96-3ffe9c435d71 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3a6e016a-b087-48d4-ae96-3ffe9c435d71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:03:56.980448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:56.981374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:56.982949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 407/795] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:03:56.983447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19185568-e595-460d-8353-22f496499775 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:56.983447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19185568-e595-460d-8353-22f496499775 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:56.983805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19185568-e595-460d-8353-22f496499775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:56.987309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.005988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-19185568-e595-460d-8353-22f496499775 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:57.008420 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-19185568-e595-460d-8353-22f496499775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:57.050744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0329db4-d38f-4acb-951a-f5d9d4d18f48 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.053053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.089485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.090482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.090933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.091370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.092059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:57.092368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:57.093772 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:57.094445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 408/796] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:03:57.096238 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19185568-e595-460d-8353-22f496499775 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.099172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 389/797] 10.222.0.71 () {56 vars in 1124 bytes} [Tue Aug 2 09:03:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:57.105476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.216906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19185568-e595-460d-8353-22f496499775 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.221939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bbed-9965-40e5-a961-ce5570e15170 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.232075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.253069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.253689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.254000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.254281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.255084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:57.255344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:57.256780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:57.259120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315af5d3-f38b-45cb-aeae-0dc7b79ad4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.259738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af5d3-f38b-45cb-aeae-0dc7b79ad4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.260027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af5d3-f38b-45cb-aeae-0dc7b79ad4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.260302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af5d3-f38b-45cb-aeae-0dc7b79ad4f7 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.260977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af5d3-f38b-45cb-aeae-0dc7b79ad4f7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:57.261285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af5d3-f38b-45cb-aeae-0dc7b79ad4f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:57.262694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af5d3-f38b-45cb-aeae-0dc7b79ad4f7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:57.277123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 390/798] 10.222.0.71 () {56 vars in 1124 bytes} [Tue Aug 2 09:03:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:57.277123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2802-62da-4794-b421-938d6211b4bb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.277123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2802-62da-4794-b421-938d6211b4bb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.277123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2802-62da-4794-b421-938d6211b4bb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.277123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 391/799] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:57.277123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2802-62da-4794-b421-938d6211b4bb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.277610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 409/800] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:57.277610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.310357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.383091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f323a2-3f97-4b7e-afc2-460426d95b4f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.390704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2802-62da-4794-b421-938d6211b4bb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.416260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88be7-b788-4c81-a026-5bf7b32142e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.416882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88be7-b788-4c81-a026-5bf7b32142e5 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.417167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88be7-b788-4c81-a026-5bf7b32142e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.417446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88be7-b788-4c81-a026-5bf7b32142e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.418185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88be7-b788-4c81-a026-5bf7b32142e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:57.419551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88be7-b788-4c81-a026-5bf7b32142e5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:57.427582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.428584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.429627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.430171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.441360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:57.446894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:57.453035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 392/801] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:57.453958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.481193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.510010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 410/802] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:03:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:57.511848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee793c5-c2e6-45b6-8290-542dc3388699 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.512138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee793c5-c2e6-45b6-8290-542dc3388699 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.512492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee793c5-c2e6-45b6-8290-542dc3388699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.533031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-fee793c5-c2e6-45b6-8290-542dc3388699 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:57.534455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fee793c5-c2e6-45b6-8290-542dc3388699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:57.574131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585627bc-c1c5-4762-bfc9-eeb333cdeea9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.627677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 411/803] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:03:57.628832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee793c5-c2e6-45b6-8290-542dc3388699 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.634554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.635546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.635978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.636413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/72bd8d0e197643a58f5becd38d1ab474/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.639590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=72bd8d0e197643a58f5becd38d1ab474, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:57.643310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:57.662532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.724065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 393/804] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:03:57 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/72bd8d0e197643a58f5becd38d1ab474/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:03:57.725153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.769643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee793c5-c2e6-45b6-8290-542dc3388699 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.824286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.825361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.825918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.826425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:57.827379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:57.827892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:57.829475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:57.845922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 412/805] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:57.863830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:57.921646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.939158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088544-4ecc-430e-8379-98e3f1191ce0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:57.988141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:57.994147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:57.995411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:57.995848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:57.996574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.011035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:03:58.015004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b1bbe-8801-4607-8e68-f9f5c79902aa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:03:58.018657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:58.019702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:58.021319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 394/806] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:03:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:58.027132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.058223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6370d5-19be-4ced-b64d-2400694f3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.058873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6370d5-19be-4ced-b64d-2400694f3328 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.059149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6370d5-19be-4ced-b64d-2400694f3328 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.059429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6370d5-19be-4ced-b64d-2400694f3328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.075029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6370d5-19be-4ced-b64d-2400694f3328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.077413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6370d5-19be-4ced-b64d-2400694f3328 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0f6370d5-19be-4ced-b64d-2400694f3328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:58.096192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:58.097168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:58.098540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:58.098540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:58.098540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:58.098540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:58.098540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 413/807] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:58.098982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7f28c-fc67-448a-a5c3-7bf50bc4317c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.099145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7f28c-fc67-448a-a5c3-7bf50bc4317c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.099663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7f28c-fc67-448a-a5c3-7bf50bc4317c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.101906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 414/808] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:58.106557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7f28c-fc67-448a-a5c3-7bf50bc4317c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.154490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac0c1-c6e5-494b-b15f-5f6e09e27b5e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.188365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3c162-787c-432c-8fe3-3b923935b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.189132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c162-787c-432c-8fe3-3b923935b44a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.189419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c162-787c-432c-8fe3-3b923935b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.189704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c162-787c-432c-8fe3-3b923935b44a None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.190466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c162-787c-432c-8fe3-3b923935b44a None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:58.190777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c162-787c-432c-8fe3-3b923935b44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.192151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c162-787c-432c-8fe3-3b923935b44a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.201414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 395/809] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:03:58.202800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161d5a6-b208-4ae6-8a7f-9595ccfaa366 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.203091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161d5a6-b208-4ae6-8a7f-9595ccfaa366 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.203369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161d5a6-b208-4ae6-8a7f-9595ccfaa366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.222661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7161d5a6-b208-4ae6-8a7f-9595ccfaa366 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:58.223874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7161d5a6-b208-4ae6-8a7f-9595ccfaa366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:03:58.234895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:58.242258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7f28c-fc67-448a-a5c3-7bf50bc4317c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.271703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:58.280028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.280711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.280970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.281479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.281937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:58.282288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.283992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.301805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 415/810] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:58.303205 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.319070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 396/811] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:03:58.320883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161d5a6-b208-4ae6-8a7f-9595ccfaa366 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.429978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb7e7c-8dcc-4cbd-a446-424df652787f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.431060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161d5a6-b208-4ae6-8a7f-9595ccfaa366 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.473301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.473984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.474269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.474806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.478889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.479794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.480273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.480764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.486052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.487569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.490761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.492936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:58.503354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:58.504315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:58.505206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:58.505206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:58.505206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:58.505206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:58.505206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 416/812] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:58.505799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:58.509555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:58.510489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:03:58.511447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:03:58.513681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 397/813] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:58.519315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.524316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:58.550698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:58.615031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222b0c-a33b-491a-95cb-77d1578e2e39 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.634197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665e487-8273-4b74-a28d-92fc68d10bd7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.650750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.651390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.651677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.651957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] PATH_INFO: `/v3/services/network` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.652590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.654307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:58.664313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:58.665818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:58.666809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 417/814] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:58.667755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.677022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.677952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.678394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.679537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.680486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:58.680992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.682682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.696480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 398/815] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:58.697606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.767261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:58.779493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999524-dc19-42f0-aead-1d4f28430d23 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.779493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:58.809309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f811d6-f06d-43cf-9987-a04bc5ff71c6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.813978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.814608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.814940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.820727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.820727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:58.820727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.820727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.843081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 418/816] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:58.843081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.856059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:58.856925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:58.857359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:58.857874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:58.858837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] RBAC: Adding query filter params (name=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:58.859332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:58.861029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:58.867877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 399/817] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:58.869108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:58.973710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742da0f7-81a0-488b-851c-18e5702fffc8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:58.979729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b011-ee7e-4a8d-b067-4cd9786b9a16 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.008912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.015226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.016059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.016567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.017028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.017850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.018639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.028081 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.028081 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.028284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.028284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:03:59.041464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:59.042473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:03:59.043469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:59.046032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 419/818] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:59.047200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.077615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.095775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.097372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.163914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693ec9-7545-4374-8479-9f88e21ec1b9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.205525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 400/819] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:03:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:59.206740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.209585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.212095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.212570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.213001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.213862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] RBAC: Adding query filter params (type=network) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:59.214312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.215863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.223488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 420/820] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:03:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:59.224759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.243119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.324398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50a7ad-dd41-422f-beae-2709c01bc169 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.338067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.354354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2c830-908a-45ea-ad29-0a6798581720 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.367997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.368958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.369236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.369519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.370554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:59.370878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.373172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.393404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.394303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.394750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.395137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.398356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 401/821] 10.222.0.71 () {56 vars in 1149 bytes} [Tue Aug 2 09:03:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:59.399196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.407194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.408907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:59.426309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:59.427634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:59.430215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:59.430215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:59.430215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:59.430215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:59.434383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 421/822] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:59.435328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.512254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.533953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339c3cf-15f5-4812-939a-3384c43941eb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.554929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54623f23-54d9-4149-8d9a-0442fd749c4a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.572911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.573543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.573863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.574143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.574998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.576361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.598818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.600164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.600809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.601327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.609447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.613322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.614907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:03:59.629630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:03:59.630597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:03:59.631509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:03:59.631509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:03:59.631509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:03:59.631509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:03:59.631509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 422/823] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:03:59.632872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.664046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 402/824] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:03:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:03:59.668050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.833516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f2bc7-c90f-4272-b707-ed207c92b269 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.885078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122b87-5a70-4351-a19b-05b2656f61af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.885300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122b87-5a70-4351-a19b-05b2656f61af None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.885663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122b87-5a70-4351-a19b-05b2656f61af None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.886646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122b87-5a70-4351-a19b-05b2656f61af None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.886768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122b87-5a70-4351-a19b-05b2656f61af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:59.887091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122b87-5a70-4351-a19b-05b2656f61af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.888599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9386-5335-4a28-bc37-ab87f4142e36 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:03:59.888741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122b87-5a70-4351-a19b-05b2656f61af None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.905488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 423/825] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:59.906830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4042-bc67-4fdc-9c25-0e90743ca9ce None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.907116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4042-bc67-4fdc-9c25-0e90743ca9ce None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.907392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4042-bc67-4fdc-9c25-0e90743ca9ce None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.908854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 424/826] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:03:59.914760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4042-bc67-4fdc-9c25-0e90743ca9ce None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:03:59.941382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e171-d872-4fc7-bf44-8c2dd7066459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:03:59.942178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e171-d872-4fc7-bf44-8c2dd7066459 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.942513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e171-d872-4fc7-bf44-8c2dd7066459 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.942858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e171-d872-4fc7-bf44-8c2dd7066459 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.943635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e171-d872-4fc7-bf44-8c2dd7066459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:03:59.944013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e171-d872-4fc7-bf44-8c2dd7066459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:03:59.946027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e171-d872-4fc7-bf44-8c2dd7066459 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:03:59.960121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 403/827] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:03:59.961605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb961d-eea3-4bad-9c44-0468a1cfcf69 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:03:59.962039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb961d-eea3-4bad-9c44-0468a1cfcf69 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:03:59.962601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb961d-eea3-4bad-9c44-0468a1cfcf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:03:59.968800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.974239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:59.981291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4ccb961d-eea3-4bad-9c44-0468a1cfcf69 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:03:59.982524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4ccb961d-eea3-4bad-9c44-0468a1cfcf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:00.030655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4042-bc67-4fdc-9c25-0e90743ca9ce None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.050198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 404/828] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:03:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:00.051790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf51518-8479-47ce-ac32-4d504f3df242 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.051790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf51518-8479-47ce-ac32-4d504f3df242 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.051998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf51518-8479-47ce-ac32-4d504f3df242 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.057856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 405/829] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:00.057856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf51518-8479-47ce-ac32-4d504f3df242 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.069506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2501bd-490e-428a-9379-23d54b09aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.070316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2501bd-490e-428a-9379-23d54b09aa10 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.070672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2501bd-490e-428a-9379-23d54b09aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.071019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2501bd-490e-428a-9379-23d54b09aa10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.078113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2501bd-490e-428a-9379-23d54b09aa10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.079563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2501bd-490e-428a-9379-23d54b09aa10 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ef2501bd-490e-428a-9379-23d54b09aa10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:00.091028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:00.091947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:00.092852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 425/830] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:00.093382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0566-da98-4ee7-b700-8a11cac5978a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.093669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0566-da98-4ee7-b700-8a11cac5978a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.094042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0566-da98-4ee7-b700-8a11cac5978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.112227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-703e0566-da98-4ee7-b700-8a11cac5978a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:00.113414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-703e0566-da98-4ee7-b700-8a11cac5978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:00.169445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf51518-8479-47ce-ac32-4d504f3df242 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.180895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 426/831] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:00.181744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e0566-da98-4ee7-b700-8a11cac5978a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.202152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.207534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.208236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.208516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.208793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.217421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.218987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.219704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:00.230699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:00.231802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 406/832] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:00.232782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.287276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e0566-da98-4ee7-b700-8a11cac5978a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.323753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.324388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.324685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.324942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.325567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.326952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.333276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071cad5-83f8-4b98-b941-04acfb6a81aa None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:00.336149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:00.337314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:00.338596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 427/833] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:00.339405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.369797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.370406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.370696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.370980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.371734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:00.372042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.373484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.386134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 407/834] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:00.386924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.434882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.438151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100acb1d-535a-4e31-b9da-08330385c24b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.438593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.471605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.472239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.472529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.472806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.483462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:00.485199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511146a0-b337-4d62-894d-732620ee3566 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:00.488361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:00.489386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:00.490510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 428/835] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:00.492436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.522844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.523464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.523754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.524035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.524784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:00.525093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.526566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.538410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 408/836] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:00.539517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.590823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc7598-32f6-4365-95b5-05e2dc850973 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.624219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.624757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.625038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.625315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.626026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:00.626346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.627730 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.632783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 429/837] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:00.633547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.644100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab5985-0dcc-4b58-b088-de52600d9044 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.657600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.658818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.678400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.679146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.679430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.679707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.680498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8771927999ea4471a4673dead83336e5) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:00.680811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.682346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.688207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 409/838] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/role_assignments?user.id=8771927999ea4471a4673dead83336e5&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:00.689014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.743274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314b3d-90ae-43cb-b8d4-e20723086b7b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.784869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.785452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.785754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.786038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.786761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:00.787063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.788937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.801781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 430/839] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:00.801781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.811410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db86f3-a097-464b-8a92-07d560ca7ac5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.854450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.855123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.855407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.855688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/15a779d5df5c4df3bac4ef4fa47c5948/roles/2e815411a02a4cf19b45effcfbb0896c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.876176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=15a779d5df5c4df3bac4ef4fa47c5948, role_id=2e815411a02a4cf19b45effcfbb0896c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.877679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.903576 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:00.918512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee54663-b095-4fc4-9c9f-f1cd45796316 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:00.957783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:00.957783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:00.957783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:00.957783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:00.958248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:00.958248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:00.958248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:00.958757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 410/840] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:04:00 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/15a779d5df5c4df3bac4ef4fa47c5948/roles/2e815411a02a4cf19b45effcfbb0896c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:00.959982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:00.969745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 431/841] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:01.009191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:01.104208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff663270-fda2-4262-b780-0439cdff70ba None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:01.143958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:01.144990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:01.145473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:01.145970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:01.159671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:01.161502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:01.177965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:01.179613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:01.180646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:01.180646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:01.180646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:01.180646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:01.182215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 411/842] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:01.187994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:01.298666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a432e-11fb-4053-b8b2-d22bd07b713c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:01.337217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:01.338144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:01.338998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:01.339494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:01.340389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:01.340838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:01.342447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:01.355832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 432/843] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:01.361225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:01.444706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:01.466507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3308-084f-4c1c-8a40-691ade878ec0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:01.503031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:01.503685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:01.503967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:01.504245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:01.512608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:01.514097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:01.525479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:01.526509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:01.528055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 412/844] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:04:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:01.532570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:01.550778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:01.639832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b9ee-5cb1-40c0-bd4c-8bd825b2ee9c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:01.674859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:01.675773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:01.676259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:01.676739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:01.677766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:01.678317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:01.680067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:01.699906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 433/845] 10.222.0.71 () {56 vars in 1135 bytes} [Tue Aug 2 09:04:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:01.707734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:01.812831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a3101-e567-45d1-92dc-0417f783fbe3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:01.848191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:01.852437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:01.852437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:01.852437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:01.859012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:01.922596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:01.924056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:02.025553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 413/846] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:02.031042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:02.096823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:02.130565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5c2e-ec50-4ca9-bd86-db78340371ec None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:02.166284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:02.166928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.167209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.167483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.178010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:02.179609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:02.195540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:02.196467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:02.197372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:02.197372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:02.197372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:02.197372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:02.197372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 434/847] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:02.202272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:02.247917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:02.310402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312e9b-6bfe-4e0e-abc3-90b8ccc76811 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:02.346002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:02.346624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.346905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.347178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.347869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:02.348172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:02.349811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:02.362382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 414/848] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:02.368758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:02.474015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885a14-fe6e-4d20-a96a-b7cbf6f64aaa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:02.499958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:02.515300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:02.515944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.517942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.517942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.523937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:02.525384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:02.536906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:02.537829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:02.539069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 435/849] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:02.545969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:02.648891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:02.654374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1282b7-7ecf-49ed-a8f0-db3998fe9b57 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:02.690565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23451d4c-815e-42bc-8584-103730fd6565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:02.691191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451d4c-815e-42bc-8584-103730fd6565 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.691760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451d4c-815e-42bc-8584-103730fd6565 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.692043 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451d4c-815e-42bc-8584-103730fd6565 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.692801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451d4c-815e-42bc-8584-103730fd6565 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:02.693108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451d4c-815e-42bc-8584-103730fd6565 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:02.695226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451d4c-815e-42bc-8584-103730fd6565 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:02.708611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 415/850] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:02.715075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:02.775815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2494f-6859-452f-90ee-5cf892eb0191 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.776140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2494f-6859-452f-90ee-5cf892eb0191 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.776374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2494f-6859-452f-90ee-5cf892eb0191 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.777923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 416/851] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:02.783214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc233-3ed5-4fd2-ad26-b6e12a640476 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.783760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc233-3ed5-4fd2-ad26-b6e12a640476 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.784258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc233-3ed5-4fd2-ad26-b6e12a640476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.808445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-880fc233-3ed5-4fd2-ad26-b6e12a640476 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:02.810024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-880fc233-3ed5-4fd2-ad26-b6e12a640476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:02.835857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2a2e-44b1-49ec-a302-e91b8856b890 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:02.883912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:02.884786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:02.885242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:02.885664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:02.886620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=72bd8d0e197643a58f5becd38d1ab474) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:02.887078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:02.888684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:02.901948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 436/852] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/role_assignments?user.id=72bd8d0e197643a58f5becd38d1ab474&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:02.902113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 417/853] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 02 09:04:02.919896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc233-3ed5-4fd2-ad26-b6e12a640476 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.026113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:03.035384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc233-3ed5-4fd2-ad26-b6e12a640476 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.072769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10c5d6-39f7-46a5-9abd-3bad3768ca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.073441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c5d6-39f7-46a5-9abd-3bad3768ca90 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.073812 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c5d6-39f7-46a5-9abd-3bad3768ca90 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.074099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c5d6-39f7-46a5-9abd-3bad3768ca90 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.074726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10c5d6-39f7-46a5-9abd-3bad3768ca90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:03.076214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10c5d6-39f7-46a5-9abd-3bad3768ca90 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6c10c5d6-39f7-46a5-9abd-3bad3768ca90 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:03.086075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:03.087032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:03.087872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 418/854] 10.222.0.71 () {56 vars in 1132 bytes} [Tue Aug 2 09:04:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:03.093362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.143819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:03.197322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b4f3d-674e-4a08-8b4e-a86edd2cb7e8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.197905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b4f3d-674e-4a08-8b4e-a86edd2cb7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.198375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b4f3d-674e-4a08-8b4e-a86edd2cb7e8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.200173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 419/855] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:03.203246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cf41c-7e9e-4230-8bc0-704c8ba7f936 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.205331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57550a-8c23-4c58-b1e3-8890f737de9a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.205624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57550a-8c23-4c58-b1e3-8890f737de9a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.205932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57550a-8c23-4c58-b1e3-8890f737de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.224794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a57550a-8c23-4c58-b1e3-8890f737de9a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:03.226089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a57550a-8c23-4c58-b1e3-8890f737de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:03.239355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab25d17-75b1-4b8d-b4ab-6d298f27205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.239980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab25d17-75b1-4b8d-b4ab-6d298f27205e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.240269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab25d17-75b1-4b8d-b4ab-6d298f27205e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.240550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab25d17-75b1-4b8d-b4ab-6d298f27205e None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.241409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab25d17-75b1-4b8d-b4ab-6d298f27205e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:03.241707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab25d17-75b1-4b8d-b4ab-6d298f27205e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:03.243109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab25d17-75b1-4b8d-b4ab-6d298f27205e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:03.249943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 437/856] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:03.249943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf96c-aa5d-4aef-bb52-e79444c107b1 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.249943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf96c-aa5d-4aef-bb52-e79444c107b1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.250225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf96c-aa5d-4aef-bb52-e79444c107b1 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.251531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 438/857] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:03.257694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0390d-079c-429f-8ead-c65d0ba65bab None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.258120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0390d-079c-429f-8ead-c65d0ba65bab None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.258403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0390d-079c-429f-8ead-c65d0ba65bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.279049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c0f0390d-079c-429f-8ead-c65d0ba65bab None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:03.280245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c0f0390d-079c-429f-8ead-c65d0ba65bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:03.297500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 420/858] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:03.302597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57550a-8c23-4c58-b1e3-8890f737de9a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.358726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 439/859] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:03.361939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0390d-079c-429f-8ead-c65d0ba65bab None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.403412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:03.406097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:03.422760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57550a-8c23-4c58-b1e3-8890f737de9a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.466305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.467029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.467349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.467887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.468853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:03.469164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:03.470194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0390d-079c-429f-8ead-c65d0ba65bab None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.470582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:03.486071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 421/860] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:03.486071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.514249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.514916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.515198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.515469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.529777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:03.535099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:03.536133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:04:03.537029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:03.541599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 440/861] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:03.542612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.639858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3c3a-3874-48f3-a88b-18d57df75abd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.674074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:03.678265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad055a6-aa63-4d17-8e26-f692d13b40ff None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.685450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.686173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.687080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.687080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.687844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:03.689654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:03.716845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.717435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.717750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.718034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.718764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:03.719065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:03.720433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:03.730165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 441/862] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:03.735374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.765863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 422/863] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:04:03 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:03.856534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807024b-6faa-4fdf-a809-6f3954b14778 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:03.903463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:03.904151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:03.904438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:03.904710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:03.920156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:03.921981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:03.937562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:03.938770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:03.939964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:03.939964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:03.939964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:03.939964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:03.941492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 442/864] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:03.948084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:03.958002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:04.062283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb043-84f8-4b37-b30e-fe8752b947b7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:04.097797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:04.098419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:04.098698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:04.098971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:04.099914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:04.100214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:04.102372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:04.114825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 423/865] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:04.120812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:04.139158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:04.229829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77e64a-5e83-404d-adbe-a69c8370147d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:04.264888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:04.265801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:04.266230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:04.266673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:04.274812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:04.276450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:04.289851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:04.291029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:04.292192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:04.294449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 443/866] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:04:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:04.300124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:04.368808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:04.404699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175f75c-c0ab-476e-b633-20e7cdda80e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:04.440002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:04.440872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:04.441325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:04.441779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:04.442719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:04.443169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:04.445278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:04.464849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 424/867] 10.222.0.71 () {56 vars in 1149 bytes} [Tue Aug 2 09:04:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:04.470599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:04.541152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:04.575732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bbffc-3ef6-44d0-8ef0-6a8834d98296 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:04.611241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:04.611857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:04.612493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:04.612776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:04.684328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:04.685831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:04.766122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:04.792864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 444/868] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:04 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:04.798411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:04.908782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d701e9-c4a9-45bc-bc60-bc91ca83926b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:04.934716 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:04.946937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ef685-dde8-4a98-91f0-727d930c9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:04.957427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef685-dde8-4a98-91f0-727d930c9324 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:04.957427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef685-dde8-4a98-91f0-727d930c9324 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:04.957427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef685-dde8-4a98-91f0-727d930c9324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:04.958997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ef685-dde8-4a98-91f0-727d930c9324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:04.961633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ef685-dde8-4a98-91f0-727d930c9324 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-207ef685-dde8-4a98-91f0-727d930c9324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:04.978822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:04.979932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:04.981051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:04.981051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:04.981051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:04.981051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:04.981051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 425/869] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:04.987231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.090605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b739-6b21-4c3d-96b4-defa00e79c9d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.090932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b739-6b21-4c3d-96b4-defa00e79c9d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.091166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b739-6b21-4c3d-96b4-defa00e79c9d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.092788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 426/870] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:05.094365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4683092-ccea-4651-94f0-f6569bbd7483 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:05.097569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f35cd-df0e-428c-a7a3-8d02340e81e3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.097908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f35cd-df0e-428c-a7a3-8d02340e81e3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.098189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f35cd-df0e-428c-a7a3-8d02340e81e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.117495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1a1f35cd-df0e-428c-a7a3-8d02340e81e3 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:05.118731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a1f35cd-df0e-428c-a7a3-8d02340e81e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:05.140435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:05.141323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.141604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.141912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.142743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:05.143367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:05.145232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:05.165799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 445/871] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:05.167024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.195849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 427/872] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:05.203927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:05.214719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f35cd-df0e-428c-a7a3-8d02340e81e3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.308071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445fca-9c47-4dd1-8685-c069531620f7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:05.340205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f35cd-df0e-428c-a7a3-8d02340e81e3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:05.347083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:05.348043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.348533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.348983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:05.350047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.358797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:05.361885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:05.373690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:05.374621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:05.375519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:05.377979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 446/873] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:05.380791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:05.381443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.385868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.385868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.385868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:05.386179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.386257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:05.397624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:05.398778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:05.399809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 428/874] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:05.404989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.507237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:05.519570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5168d-d103-4460-91ae-7c9cf79619ba None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:05.555810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a205d0-3135-47d1-802a-688c4de6b089 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:05.558022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:05.559670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.560065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.560449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.561328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:05.561833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:05.563308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:05.585970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 447/875] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:05.589273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.600390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:05.601663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.602108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.602390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.603323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:05.603435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:05.604736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:05.613863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 429/876] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:05.615942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.654595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:05.722286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeabdc5-fb13-4e95-80c3-9fef39ccc11b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:05.738678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0b540-7ca7-4a3a-8bf3-6affd01dd479 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:05.764486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16380-b031-47c1-82a4-1d9c9fe65d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:05.765518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16380-b031-47c1-82a4-1d9c9fe65d85 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.765952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16380-b031-47c1-82a4-1d9c9fe65d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.766228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16380-b031-47c1-82a4-1d9c9fe65d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.767266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16380-b031-47c1-82a4-1d9c9fe65d85 None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=15a779d5df5c4df3bac4ef4fa47c5948) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:05.767974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16380-b031-47c1-82a4-1d9c9fe65d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:05.770019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16380-b031-47c1-82a4-1d9c9fe65d85 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:05.775650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af01a-8d36-42b0-a3f2-2c403b652301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:05.776266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af01a-8d36-42b0-a3f2-2c403b652301 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.776553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af01a-8d36-42b0-a3f2-2c403b652301 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.776833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af01a-8d36-42b0-a3f2-2c403b652301 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.785772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 448/877] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:05 2022] GET /identity/v3/role_assignments?user.id=15a779d5df5c4df3bac4ef4fa47c5948&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:05.786024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af01a-8d36-42b0-a3f2-2c403b652301 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:05.786024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af01a-8d36-42b0-a3f2-2c403b652301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:05.786197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ddb12-5182-4460-a834-081f92fff49d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.786197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ddb12-5182-4460-a834-081f92fff49d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.786197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ddb12-5182-4460-a834-081f92fff49d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.786427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af01a-8d36-42b0-a3f2-2c403b652301 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:05.786500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 449/878] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:05.786500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f584-9929-49bc-a853-8a6d084cddef None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.786771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f584-9929-49bc-a853-8a6d084cddef None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.787181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f584-9929-49bc-a853-8a6d084cddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.802285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 430/879] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:05.808447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a505f584-9929-49bc-a853-8a6d084cddef None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:05.809743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a505f584-9929-49bc-a853-8a6d084cddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:05.820002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:05.855786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed33f-4925-4052-9e7c-5d53bb0e65a8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.856129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed33f-4925-4052-9e7c-5d53bb0e65a8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.856350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed33f-4925-4052-9e7c-5d53bb0e65a8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.858136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 431/880] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:05.875301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7f0b-2672-4bde-941f-021ea68b1156 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:05.875797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7f0b-2672-4bde-941f-021ea68b1156 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:05.876225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7f0b-2672-4bde-941f-021ea68b1156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:05.894602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 450/881] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:05.899104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ef9b7f0b-2672-4bde-941f-021ea68b1156 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:05.900710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ef9b7f0b-2672-4bde-941f-021ea68b1156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:05.918564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f584-9929-49bc-a853-8a6d084cddef None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:05.995733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 432/882] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:06.019550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b7f0b-2672-4bde-941f-021ea68b1156 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.047579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f584-9929-49bc-a853-8a6d084cddef None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.061024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:06.086816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.087551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.087780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.088002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.088705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.090114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.147297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b7f0b-2672-4bde-941f-021ea68b1156 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.183600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.184256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.184537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.184814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.185509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.187086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.195834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 451/883] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:04:05 2022] POST /identity/v3/services => generated 269 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:06.197209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:06.198232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:06.199559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 433/884] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:06.204752 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.208748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:06.338270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd9d9b-342d-4181-b28d-a626a213dd5c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.378269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.379339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.379937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.380418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.381332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:06.381825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.383410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.389073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 452/885] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:06.394500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.493369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:06.503203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4b0ec-9fcb-4fe7-93bf-13daef78c257 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.538206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.539439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.540115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.541019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.541877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:06.542343 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.543864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.549665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 434/886] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:06.557753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.622300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:06.662461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6ae6d-6efa-4aeb-8403-8645965d18bf None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.698904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa314aa-277d-4c0e-ac24-d4a689aa7780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.699528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa314aa-277d-4c0e-ac24-d4a689aa7780 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.699810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa314aa-277d-4c0e-ac24-d4a689aa7780 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.700086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa314aa-277d-4c0e-ac24-d4a689aa7780 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.700845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa314aa-277d-4c0e-ac24-d4a689aa7780 None admin] RBAC: Adding query filter params (interface=public, service_id=66a9773ca5864968b0f54f4fbfb57b02, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:06.701152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa314aa-277d-4c0e-ac24-d4a689aa7780 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.702549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa314aa-277d-4c0e-ac24-d4a689aa7780 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.708241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 453/887] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/endpoints?service_id=66a9773ca5864968b0f54f4fbfb57b02&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:06.714240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:06.818119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f992017-0223-4894-aba1-1a327fbb59f3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:06.854557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f01a1-00ab-45a3-be88-24a994fae48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:06.855226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f01a1-00ab-45a3-be88-24a994fae48d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:06.855507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f01a1-00ab-45a3-be88-24a994fae48d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:06.855781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f01a1-00ab-45a3-be88-24a994fae48d None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:06.856430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f01a1-00ab-45a3-be88-24a994fae48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:06.857877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f01a1-00ab-45a3-be88-24a994fae48d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:06.883850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 435/888] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:04:06 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:07.891853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8aa9e-e4cf-4802-853b-812377fcb23e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:07.892384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8aa9e-e4cf-4802-853b-812377fcb23e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:07.892384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8aa9e-e4cf-4802-853b-812377fcb23e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:07.894005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 454/889] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:07.900023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2fdd-05b9-41ae-b642-c821d913a666 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:07.900444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2fdd-05b9-41ae-b642-c821d913a666 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:07.905340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2fdd-05b9-41ae-b642-c821d913a666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:07.919859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-32cb2fdd-05b9-41ae-b642-c821d913a666 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:07.921052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-32cb2fdd-05b9-41ae-b642-c821d913a666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:07.938066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:07.995935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4bbde-b547-4469-b17b-3cabb29ec507 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:07.996290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4bbde-b547-4469-b17b-3cabb29ec507 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:07.996494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4bbde-b547-4469-b17b-3cabb29ec507 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:07.998118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 455/890] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:08.002370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 436/891] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:08.003105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624535c-e376-4414-b907-584993684af2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.003396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624535c-e376-4414-b907-584993684af2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.003676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624535c-e376-4414-b907-584993684af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.026752 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8624535c-e376-4414-b907-584993684af2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:08.029249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb2fdd-05b9-41ae-b642-c821d913a666 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.030136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8624535c-e376-4414-b907-584993684af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:08.102607 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 456/892] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:08.131365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624535c-e376-4414-b907-584993684af2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.148056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb2fdd-05b9-41ae-b642-c821d913a666 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:08.185094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:08.185674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.185984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.186266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.186978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:08.188368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:08.193244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:08.237982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624535c-e376-4414-b907-584993684af2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:08.274443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018fe8e-c714-4d1a-9f1d-b636161bac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:08.275097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018fe8e-c714-4d1a-9f1d-b636161bac43 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.275373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018fe8e-c714-4d1a-9f1d-b636161bac43 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.275650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018fe8e-c714-4d1a-9f1d-b636161bac43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.290070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018fe8e-c714-4d1a-9f1d-b636161bac43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:08.292418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 437/893] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:04:08 2022] POST /identity/v3/services => generated 241 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-c018fe8e-c714-4d1a-9f1d-b636161bac43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:08.296014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:08.297021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:08.298332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:08.300962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 457/894] 10.222.0.71 () {56 vars in 1120 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:08.308139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.311947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ccee3-833d-4bd9-9d6e-b36eb5df6398 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.311947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ccee3-833d-4bd9-9d6e-b36eb5df6398 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.311947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ccee3-833d-4bd9-9d6e-b36eb5df6398 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.312611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 458/895] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:08.318277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101abb3-211d-4123-ab35-8ecbe953c15b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.318567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101abb3-211d-4123-ab35-8ecbe953c15b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.330454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101abb3-211d-4123-ab35-8ecbe953c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.330593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:08.343599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c101abb3-211d-4123-ab35-8ecbe953c15b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:08.345281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c101abb3-211d-4123-ab35-8ecbe953c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:08.449806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e717b-0bcf-4018-935a-34f9e340c7e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:08.450625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 459/896] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:08.471277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101abb3-211d-4123-ab35-8ecbe953c15b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.492558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:08.493178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.493463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.493984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.494847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:08.494847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:08.496175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:08.505214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 438/897] 10.222.0.71 () {56 vars in 1115 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:08.511853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.526161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:08.593194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:08.610160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101abb3-211d-4123-ab35-8ecbe953c15b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:08.627788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f35a4a-8f1c-4f57-841d-b0e5ec19fb36 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:08.656763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:08.657572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.657886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.658173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.659134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:08.660819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:08.667826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:08.668646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.669068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.669482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:08.672716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:08.673909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:08.674925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:08.679485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 460/898] 10.222.0.71 () {56 vars in 1132 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:08.680718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.685615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:08.687395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:08.703728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:08.704813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:08.705853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:08.705853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:08.705853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:08.705853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:08.712754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 439/899] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:08.713924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.800415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36c92d-3d28-4691-8f63-8c57b1deeee5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:08.808958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:08.825309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5819d-cac9-44f8-840b-78a05a39264d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:08.837817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:08.838446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.838731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.839045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.839696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:08.840004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:08.841428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:08.853404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:08.853830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 461/900] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:08.855197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.868995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:08.871321 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:08.871406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:08.871640 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:08.873063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:08.873373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:08.875015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:08.902095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 440/901] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:08.904717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:08.983523 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31519e6-5fa8-4237-a895-535bd3753902 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.024128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656ecca-bcb9-4e4c-a5ae-c6c7a14ae1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.024512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656ecca-bcb9-4e4c-a5ae-c6c7a14ae1cc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.024791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656ecca-bcb9-4e4c-a5ae-c6c7a14ae1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.025063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656ecca-bcb9-4e4c-a5ae-c6c7a14ae1cc None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.025757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656ecca-bcb9-4e4c-a5ae-c6c7a14ae1cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:09.026061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656ecca-bcb9-4e4c-a5ae-c6c7a14ae1cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.027397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce889-8399-43c1-8abd-723f15deccfe None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.027501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656ecca-bcb9-4e4c-a5ae-c6c7a14ae1cc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.038283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 462/902] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:09.038283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35c00-5a7a-4f1f-a83f-a0c1fe3f91df None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.038283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35c00-5a7a-4f1f-a83f-a0c1fe3f91df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.038283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35c00-5a7a-4f1f-a83f-a0c1fe3f91df None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.038283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 463/903] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:09.040559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35c00-5a7a-4f1f-a83f-a0c1fe3f91df None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.071142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c379f25-b802-4c9b-b6d4-439dc09bbea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.071790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c379f25-b802-4c9b-b6d4-439dc09bbea5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.072070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c379f25-b802-4c9b-b6d4-439dc09bbea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.072346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c379f25-b802-4c9b-b6d4-439dc09bbea5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.078087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.080094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c379f25-b802-4c9b-b6d4-439dc09bbea5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.081304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c379f25-b802-4c9b-b6d4-439dc09bbea5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-0c379f25-b802-4c9b-b6d4-439dc09bbea5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:09.095247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:09.096244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:09.097198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 441/904] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:04:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:09.098424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3cf6f-6630-4b18-b1f6-2ff1327d76a7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.098424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3cf6f-6630-4b18-b1f6-2ff1327d76a7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.098424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3cf6f-6630-4b18-b1f6-2ff1327d76a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.119800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-14c3cf6f-6630-4b18-b1f6-2ff1327d76a7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:09.121194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14c3cf6f-6630-4b18-b1f6-2ff1327d76a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:09.156165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35c00-5a7a-4f1f-a83f-a0c1fe3f91df None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.165356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.199257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 442/905] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:09.199257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3cf6f-6630-4b18-b1f6-2ff1327d76a7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.200977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.201733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.202141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.202425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.203246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] RBAC: Adding query filter params (interface=public, service_id=f0a942ee3c484da6bb2c01af6901b88c, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:09.203565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.204929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.215917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 464/906] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/endpoints?service_id=f0a942ee3c484da6bb2c01af6901b88c&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:09.216786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.311215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3cf6f-6630-4b18-b1f6-2ff1327d76a7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.320483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.324603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543fd94-2f6c-41f9-9c1e-ab0db94859f7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.347744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.348386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.348675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.348951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.350054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:09.350897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.352416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.362079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.362702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.362984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.363260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.363915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.365425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.371801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 465/907] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:09.372428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.375638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 443/908] 10.222.0.71 () {56 vars in 1149 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:09.381851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.431392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.514628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f0049-7562-4ed8-b748-cc7189a7db46 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.525882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb1b99-9497-4758-92b1-54a97084e849 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.558930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.559582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.559868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.560176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.560781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.562243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:09.571599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:09.572646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:04:09.573538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:09.574375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 466/909] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:09.575431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.576324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.576816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.577286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.578622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.612493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.669331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.671233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.702938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06712bbe-1ee9-4297-9033-99ed294f502d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.707036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.748650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.749272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.749559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.749869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.750553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:09.750860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.752388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.760186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 467/910] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:09.765612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.796733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 444/911] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:04:09.801742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.891693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.902607 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f16fd-6ac6-4f18-9bdf-435d601a7cca None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.935533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf5a12-cd8f-496c-98a6-8321a7eb728b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:09.940717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.941512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.941964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.942406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.943221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:09.943671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.945227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:09.955529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 468/912] 10.222.0.71 () {56 vars in 1114 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:09.956552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:09.971169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:09.971825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:09.972116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:09.972401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:09.973188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:09.984977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:09.986719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:10.003667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:10.004649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:10.005534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:10.005534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:10.005534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:10.005534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:10.010088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 445/913] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:10.011717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.072543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c3aba-6b4c-40ef-9a17-d802ccc06f26 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.108701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.109684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.110264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.110740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.111704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.113285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.122025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d8d8-04c9-4fbf-a5c9-a19d29de280e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.157391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.158049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.158332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.158612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.159310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:10.159620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.160995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.173928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 446/914] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:10.179962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.218248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 469/915] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:10.233630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.295709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9708b54-b0aa-435f-85ff-2269c1b8a083 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.340725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd39efe-537d-4870-a86b-9bd81ce2302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.341385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39efe-537d-4870-a86b-9bd81ce2302c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.341670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39efe-537d-4870-a86b-9bd81ce2302c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.341979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39efe-537d-4870-a86b-9bd81ce2302c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.349993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd39efe-537d-4870-a86b-9bd81ce2302c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.352063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd39efe-537d-4870-a86b-9bd81ce2302c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6cd39efe-537d-4870-a86b-9bd81ce2302c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:10.364752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:10.365767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:10.367006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:10.371018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 447/916] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:10.372508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.386981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.428016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f396a1-4b0b-4082-b55b-faedd95472d8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.428322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f396a1-4b0b-4082-b55b-faedd95472d8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.428638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f396a1-4b0b-4082-b55b-faedd95472d8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.430646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 448/917] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:10.436460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552829-9953-4aea-98b7-a2d6aa3afe55 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.436748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552829-9953-4aea-98b7-a2d6aa3afe55 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.437026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91552829-9953-4aea-98b7-a2d6aa3afe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.457417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-91552829-9953-4aea-98b7-a2d6aa3afe55 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:10.458801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-91552829-9953-4aea-98b7-a2d6aa3afe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:10.493201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e03a3-2736-4bc2-866e-a8e67df91958 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.533695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.534344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.534624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.534897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.535743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:10.535938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.537395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.555247 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 470/918] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:10.555471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 449/919] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:10.558826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.578324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552829-9953-4aea-98b7-a2d6aa3afe55 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.615386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.641139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.679135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3724-7850-4532-adf6-8796f7b62ed1 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.718122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.718741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.719023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.719299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.720087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] RBAC: Adding query filter params (role.id=3c2a364fb9a145a9bebc2db236a4d75f, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=15a779d5df5c4df3bac4ef4fa47c5948) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:10.720558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.720990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91552829-9953-4aea-98b7-a2d6aa3afe55 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.722057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.733742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 471/920] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/role_assignments?user.id=15a779d5df5c4df3bac4ef4fa47c5948&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=3c2a364fb9a145a9bebc2db236a4d75f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:10.764896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.765564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.765948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.766234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.766943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.768409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:10.779196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:10.780468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:10.781571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 450/921] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:10.786837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:10.917093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d54a7-48d2-4b0c-8fc2-530302403bac None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:10.955236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:10.956216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:10.956682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:10.957181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:10.958111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:10.958597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:10.960694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:10.962272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:10.967095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 472/922] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:10.975851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.082087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:11.086175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533782a-34dd-4bc6-a2db-dbd007053d7a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.122492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.123519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.123757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.124107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.124797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:11.125109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.127085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.132616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 451/923] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:11.138816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.246321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f843-8401-48fc-87be-a86f16f48cea None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.282917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f773402-1a65-45ec-82dd-859ede38fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.283539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773402-1a65-45ec-82dd-859ede38fd59 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.283823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773402-1a65-45ec-82dd-859ede38fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.284102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773402-1a65-45ec-82dd-859ede38fd59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.284860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773402-1a65-45ec-82dd-859ede38fd59 None admin] RBAC: Adding query filter params (interface=public, service_id=f735e7f905b645718ba750a06a9a325d, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:11.285170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773402-1a65-45ec-82dd-859ede38fd59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.286560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773402-1a65-45ec-82dd-859ede38fd59 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.292929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 473/924] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/endpoints?service_id=f735e7f905b645718ba750a06a9a325d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:11.298410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.430167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aba58-3dc9-4b6b-bf41-092f3d2cee18 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.465669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb6a23-6e11-44e2-829d-100b647773a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.466325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6a23-6e11-44e2-829d-100b647773a8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.466610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6a23-6e11-44e2-829d-100b647773a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.466887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb6a23-6e11-44e2-829d-100b647773a8 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.467541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb6a23-6e11-44e2-829d-100b647773a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.468923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb6a23-6e11-44e2-829d-100b647773a8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.476203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 452/925] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:11.483846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecd0fb-ec84-4d93-abe9-633d8dcfb924 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.484143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecd0fb-ec84-4d93-abe9-633d8dcfb924 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.484557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecd0fb-ec84-4d93-abe9-633d8dcfb924 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.486311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 474/926] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:11.492730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0cf17-513e-48be-a48f-76b85e90e9b3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.493013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0cf17-513e-48be-a48f-76b85e90e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.493445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0cf17-513e-48be-a48f-76b85e90e9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.518528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c6b0cf17-513e-48be-a48f-76b85e90e9b3 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:11.519723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c6b0cf17-513e-48be-a48f-76b85e90e9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:11.546291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:11.604226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 453/927] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:11.627263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecd0fb-ec84-4d93-abe9-633d8dcfb924 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.696853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:11.737034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecd0fb-ec84-4d93-abe9-633d8dcfb924 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.771904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.772495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.772783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.773059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.773687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.775191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:11.784321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:11.785334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:11.786310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 475/928] 10.222.0.71 () {56 vars in 1132 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:11.792061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0cf17-513e-48be-a48f-76b85e90e9b3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:11.899989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0cf17-513e-48be-a48f-76b85e90e9b3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:11.937548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:11.938234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:11.938513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:11.938853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:11.939555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:11.939907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:11.941319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:11.947682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 454/929] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:11.953429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:12.058008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad85b-99d5-4e79-996d-3cdd50c4d84b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:12.086778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:12.096126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89573193-d822-4e57-96bc-c9facb405430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:12.097033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573193-d822-4e57-96bc-c9facb405430 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:12.097530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573193-d822-4e57-96bc-c9facb405430 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:12.098048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573193-d822-4e57-96bc-c9facb405430 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.098991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89573193-d822-4e57-96bc-c9facb405430 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:12.099776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89573193-d822-4e57-96bc-c9facb405430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:12.102095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89573193-d822-4e57-96bc-c9facb405430 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:12.107555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 476/930] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:12.117884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:12.137551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:12.222873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61a238-d120-48ff-ac89-f7922ebbe104 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:12.260518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a6098-61a8-44c1-9b49-a7a858d53c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:12.261417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a6098-61a8-44c1-9b49-a7a858d53c02 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:12.261884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a6098-61a8-44c1-9b49-a7a858d53c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:12.262319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a6098-61a8-44c1-9b49-a7a858d53c02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.263191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a6098-61a8-44c1-9b49-a7a858d53c02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:12.264738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a6098-61a8-44c1-9b49-a7a858d53c02 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:12.365572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 455/931] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:12.482164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d329-4200-401b-80df-999904df5706 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:12.483173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d329-4200-401b-80df-999904df5706 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:12.483750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d329-4200-401b-80df-999904df5706 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.485755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 477/932] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:12.491853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c769b-8a37-4f05-98c4-6e246c427a42 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:12.492157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c769b-8a37-4f05-98c4-6e246c427a42 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:12.492417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c769b-8a37-4f05-98c4-6e246c427a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.512083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-587c769b-8a37-4f05-98c4-6e246c427a42 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:12.513317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-587c769b-8a37-4f05-98c4-6e246c427a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:12.590866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:12.597651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 456/933] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:12.622499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0d329-4200-401b-80df-999904df5706 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:12.737989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0d329-4200-401b-80df-999904df5706 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:12.775779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:12.776407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:12.776731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:12.776971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.777751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:12.779263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:12.783534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING keystone.server.flask.common [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 09:04:12.830729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.sql.core [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 09:04:12.830729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 09:04:12.830729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [parameters: {'id': 'aa78c5df1ae849fa9396b734a8c9b31b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 09:04:12.830729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa78c5df1ae849fa9396b734a8c9b31b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa78c5df1ae849fa9396b734a8c9b31b. Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:04:12.839129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result.read() Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 09:04:12.845771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application yield resource Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise self.value Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application session.commit() Aug 02 09:04:12.846964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.session.flush() Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application compat.raise_( Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 09:04:12.848113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 09:04:12.849415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application result.read() Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:04:12.851148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [parameters: {'id': 'aa78c5df1ae849fa9396b734a8c9b31b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:12.855803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:12.857462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa78c5df1ae849fa9396b734a8c9b31b. Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:12.860034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 478/934] 10.222.0.71 () {60 vars in 1140 bytes} [Tue Aug 2 09:04:12 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:12.860611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164d3b-33b9-4230-bd51-15f1f66a52cd None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:12.860611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164d3b-33b9-4230-bd51-15f1f66a52cd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:12.860611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164d3b-33b9-4230-bd51-15f1f66a52cd None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.860611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 457/935] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:12.860862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:12.860941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2716-7a0f-482d-9852-84d6b2d33aca None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:12.860941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2716-7a0f-482d-9852-84d6b2d33aca None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:12.860941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2716-7a0f-482d-9852-84d6b2d33aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:12.884984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-818d2716-7a0f-482d-9852-84d6b2d33aca None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:12.884984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-818d2716-7a0f-482d-9852-84d6b2d33aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:12.910883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:12.969455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5decb-a517-4f2c-a1e5-75082a5b805b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:12.977860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 458/936] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:13.005293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2716-7a0f-482d-9852-84d6b2d33aca None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:13.018865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:13.019803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.020413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.021013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.028882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:13.031019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:13.043931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:13.044844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:13.045780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:13.048376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 479/937] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:13.054250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:13.134120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2716-7a0f-482d-9852-84d6b2d33aca None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:13.163659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bb8b2-af49-445c-a44f-42b70ef0c2ef None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:13.171896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:13.175001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:13.185971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:13.187279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.189819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.189819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.202309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:13.202915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:13.204033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.204604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.205175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.206609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:13.207232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:13.208913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:13.210402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:13.211250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:13.211913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:13.211992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 459/938] 10.222.0.71 () {56 vars in 1120 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:13.218737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:13.241915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 480/939] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:13.339415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892e838-9c25-4578-9ef6-dae76bba7548 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:13.378673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:13.379768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.380274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.380749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.381802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:13.382326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:13.383993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:13.393969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 460/940] 10.222.0.71 () {56 vars in 1115 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:13.400992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:13.519952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0412744-f8ba-430c-a129-b69e4aaa702a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:13.555148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1480e-6552-40b9-be27-a2d16a9b72f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:13.555797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1480e-6552-40b9-be27-a2d16a9b72f1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.556074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1480e-6552-40b9-be27-a2d16a9b72f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.556347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1480e-6552-40b9-be27-a2d16a9b72f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.567850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1480e-6552-40b9-be27-a2d16a9b72f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:13.570511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1480e-6552-40b9-be27-a2d16a9b72f1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-45b1480e-6552-40b9-be27-a2d16a9b72f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:13.586637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:13.587639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:13.588545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:13.588545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:13.588545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:13.588545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:13.588545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 481/941] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:13.595698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:13.650073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:13.710193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb3086-d27a-41e7-9ee3-b01aac3519f1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:13.749359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:13.750017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.750299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.750623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.751322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:13.751711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:13.753103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:13.753409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb60f8-6301-4f39-9895-50bae6bf6880 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.753699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb60f8-6301-4f39-9895-50bae6bf6880 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.754012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb60f8-6301-4f39-9895-50bae6bf6880 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.755350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 482/942] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:13.761759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831541c-0096-44a2-ac94-4ac641bd694d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.761759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831541c-0096-44a2-ac94-4ac641bd694d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.762351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831541c-0096-44a2-ac94-4ac641bd694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.766645 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 461/943] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:13.773630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:13.784227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6831541c-0096-44a2-ac94-4ac641bd694d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:13.786280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6831541c-0096-44a2-ac94-4ac641bd694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:13.806105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:13.882641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 483/944] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:13.905916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831541c-0096-44a2-ac94-4ac641bd694d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:13.907018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bebb0-009d-4678-92a1-3c38362d494e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:13.920759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:13.950802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:13.951533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:13.951884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:13.952230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:13.962671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:13.964980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:13.981691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:13.982793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:13.984084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:13.988452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 462/945] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:13.989482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.039168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831541c-0096-44a2-ac94-4ac641bd694d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.082881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.083633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.083991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.084345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.085086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.086846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:14.098814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:14.100208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:14.101180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:14.105762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 484/946] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:14.106830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.128209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:14.131984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc08d8-c964-4389-bb62-077401cfb5dc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.171640 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.173064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.173635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.174138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.175184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:14.175700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.177459 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.197341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 463/947] 10.222.0.71 () {56 vars in 1149 bytes} [Tue Aug 2 09:04:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:14.202510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.239131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91425b68-915d-4ec7-bedc-87eed938dce9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.243047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:14.283118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.283978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.284163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.284456 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.285137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:14.285486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.286856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.299099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 485/948] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:14.300460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.348862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a653d-ecb7-4c56-967f-e29d43199665 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.386900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.387927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.388434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.389019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.394805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:14.400593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.402365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:14.418631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:14.419563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:14.420458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:14.420458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:14.420458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:14.420458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:14.420677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f499de-1046-46c3-bde9-369e0585d7a6 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.427174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 464/949] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:14.428284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.460314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.461042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.461265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.461497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.462232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:14.462542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.464099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.476021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 486/950] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:14.479047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.533213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:14.552402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c983b-628f-4d97-a1f5-b79875874673 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.590543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0383573-248e-41f6-a487-525038beb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.591157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383573-248e-41f6-a487-525038beb479 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.591437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383573-248e-41f6-a487-525038beb479 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.591726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383573-248e-41f6-a487-525038beb479 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.592394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383573-248e-41f6-a487-525038beb479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:14.592695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383573-248e-41f6-a487-525038beb479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.594082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383573-248e-41f6-a487-525038beb479 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.595713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694a9ff-269f-4203-80d0-3d50040bb14a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.612217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 465/951] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:14.612217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453813-194e-401e-9499-fcc531cc7c8e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.612217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453813-194e-401e-9499-fcc531cc7c8e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.612217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453813-194e-401e-9499-fcc531cc7c8e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.612217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 466/952] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:14.615148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53453813-194e-401e-9499-fcc531cc7c8e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.638249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f5021-221d-4856-8cd7-75fe26f59ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.638863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f5021-221d-4856-8cd7-75fe26f59ea5 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.639143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f5021-221d-4856-8cd7-75fe26f59ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.639415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f5021-221d-4856-8cd7-75fe26f59ea5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.640114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f5021-221d-4856-8cd7-75fe26f59ea5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.641609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f5021-221d-4856-8cd7-75fe26f59ea5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.651850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:14.718178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53453813-194e-401e-9499-fcc531cc7c8e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.747251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 487/953] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:14.748576 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f717d-2f77-4ae1-851f-942cb3335430 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.748927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f717d-2f77-4ae1-851f-942cb3335430 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.749278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f717d-2f77-4ae1-851f-942cb3335430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.771404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-868f717d-2f77-4ae1-851f-942cb3335430 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:14.774316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-868f717d-2f77-4ae1-851f-942cb3335430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:14.774519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.775045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.775328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.775609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.781137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:14.786329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.788629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:14.807365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:14.808467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:14.809466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:14.813904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 467/954] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:14.816653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.898436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 488/955] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:14.921385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f717d-2f77-4ae1-851f-942cb3335430 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:14.952806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475389fd-331b-4fda-b36c-131258e86226 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:14.994775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:14.995401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:14.995684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:14.995960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:14.996725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:14.997027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:14.998496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:15.016274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 468/956] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:15.017851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:15.044100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f717d-2f77-4ae1-851f-942cb3335430 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:15.078920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:15.081603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:15.092319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:15.097135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.097135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.097135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.097135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:15.097135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:15.109871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:15.111339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:15.112470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:15.115191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 489/957] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:15.121850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:15.144015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e45fca-f0a8-4c33-bf14-b41efee0e4a9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:15.195863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:15.197446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.198493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.198935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/15a779d5df5c4df3bac4ef4fa47c5948/roles/3c2a364fb9a145a9bebc2db236a4d75f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.202662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=15a779d5df5c4df3bac4ef4fa47c5948, role_id=3c2a364fb9a145a9bebc2db236a4d75f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:15.204281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:15.235220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeefee-3662-45d1-82ec-8627cbeef3e3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:15.271243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18560f-3200-4209-ab5b-ab51296927e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:15.271864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18560f-3200-4209-ab5b-ab51296927e1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.272441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18560f-3200-4209-ab5b-ab51296927e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.273007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18560f-3200-4209-ab5b-ab51296927e1 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.273581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18560f-3200-4209-ab5b-ab51296927e1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:15.273919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18560f-3200-4209-ab5b-ab51296927e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:15.282327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18560f-3200-4209-ab5b-ab51296927e1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:15.282470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 469/958] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:04:15 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/15a779d5df5c4df3bac4ef4fa47c5948/roles/3c2a364fb9a145a9bebc2db236a4d75f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:15.288441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 490/959] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:04:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:15.294857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:15.393588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0158d4-693f-4536-9caa-bd90b41cf9eb None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.393819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0158d4-693f-4536-9caa-bd90b41cf9eb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.394149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0158d4-693f-4536-9caa-bd90b41cf9eb None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.395904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 491/960] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:15.402313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fcc71-0b2d-4b76-948a-3e8bc0500a1c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.402594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fcc71-0b2d-4b76-948a-3e8bc0500a1c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.402874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fcc71-0b2d-4b76-948a-3e8bc0500a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.415763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d8ab6-9db6-46c3-854a-c44b0434114b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:15.424698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9a9fcc71-0b2d-4b76-948a-3e8bc0500a1c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:15.426658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9a9fcc71-0b2d-4b76-948a-3e8bc0500a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:15.438685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:15.465538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:15.466204 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.466489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.466768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.467461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:15.467771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:15.469173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:15.475783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 470/961] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:04:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:15.509113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:15.530327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 492/962] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:15.555682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:15.670585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2191-9a54-4131-b7ac-185de082a301 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:15.706614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:15.707564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.708063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.708517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.709466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:15.711239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:15.714018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING keystone.server.flask.common [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 09:04:15.781146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.sql.core [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 09:04:15.781146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 09:04:15.781146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [parameters: {'user_id': 'db338cada97346cfa943bb3a23b342aa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 09:04:15.781146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80520) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Aug 02 09:04:15.800147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:04:15.801142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application yield resource Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise self.value Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application session.commit() Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 09:04:15.802178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.flush() Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application compat.raise_( Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 09:04:15.803102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:04:15.804711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:04:15.806781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [parameters: {'user_id': 'db338cada97346cfa943bb3a23b342aa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:15.808785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 09:04:15.810791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 09:04:15.811929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 09:04:15.811929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 09:04:15.811929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 09:04:15.811929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 09:04:15.811929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 09:04:15.811929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:15.813629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 471/963] 10.222.0.71 () {60 vars in 1131 bytes} [Tue Aug 2 09:04:15 2022] POST /identity/v3/users => generated 160 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:15.820856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fcc71-0b2d-4b76-948a-3e8bc0500a1c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:15.930828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fcc71-0b2d-4b76-948a-3e8bc0500a1c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:15.968265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89ad41-9397-4ba7-8f56-d0cacc38ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:15.968917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ad41-9397-4ba7-8f56-d0cacc38ba49 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:15.969246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ad41-9397-4ba7-8f56-d0cacc38ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:15.969535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ad41-9397-4ba7-8f56-d0cacc38ba49 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:15.978306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89ad41-9397-4ba7-8f56-d0cacc38ba49 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:15.979821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89ad41-9397-4ba7-8f56-d0cacc38ba49 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3f89ad41-9397-4ba7-8f56-d0cacc38ba49 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:15.993527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:15.994568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:15.995606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 493/964] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:04:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:16.000778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:16.049692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:16.110046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847df12b-5b1e-498b-950e-d8041d34dc8e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:16.145955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d86ec-5ad7-43b9-892d-a3c47334153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:16.146579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d86ec-5ad7-43b9-892d-a3c47334153f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:16.146854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d86ec-5ad7-43b9-892d-a3c47334153f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:16.147665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d86ec-5ad7-43b9-892d-a3c47334153f None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:16.148755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d86ec-5ad7-43b9-892d-a3c47334153f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:16.149060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d86ec-5ad7-43b9-892d-a3c47334153f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:16.150715 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d86ec-5ad7-43b9-892d-a3c47334153f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:16.190248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 472/965] 10.222.0.71 () {56 vars in 1101 bytes} [Tue Aug 2 09:04:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:16.875170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad1306-c8bd-4638-a14f-13dd5e0b5ed1 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:16.875674 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad1306-c8bd-4638-a14f-13dd5e0b5ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:16.875844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad1306-c8bd-4638-a14f-13dd5e0b5ed1 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:16.877068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 494/966] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:16.883252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baa2e2-8486-403f-beb3-603680b5a259 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:16.883677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baa2e2-8486-403f-beb3-603680b5a259 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:16.883889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baa2e2-8486-403f-beb3-603680b5a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:16.903547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d8baa2e2-8486-403f-beb3-603680b5a259 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:16.905083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d8baa2e2-8486-403f-beb3-603680b5a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:16.978311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 473/967] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:17.001514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad1306-c8bd-4638-a14f-13dd5e0b5ed1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.050707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.109510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad1306-c8bd-4638-a14f-13dd5e0b5ed1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.143364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.143918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.144199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.144478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.145101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:17.146479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:17.156485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:17.157531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:17.158416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:17.162038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 495/968] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:17.164509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baa2e2-8486-403f-beb3-603680b5a259 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.195625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.270956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baa2e2-8486-403f-beb3-603680b5a259 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.306281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a964e-451a-4462-b337-0858bdc35dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.306899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a964e-451a-4462-b337-0858bdc35dbb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.307177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a964e-451a-4462-b337-0858bdc35dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.307450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a964e-451a-4462-b337-0858bdc35dbb None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.308116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a964e-451a-4462-b337-0858bdc35dbb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:17.308417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a964e-451a-4462-b337-0858bdc35dbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:17.309811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a964e-451a-4462-b337-0858bdc35dbb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:17.314787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 474/969] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:17.321505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.386979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdfca2-fe4d-485c-a03c-c79b5d1dde17 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.387318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdfca2-fe4d-485c-a03c-c79b5d1dde17 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.387537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdfca2-fe4d-485c-a03c-c79b5d1dde17 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.388884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 475/970] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:17.393967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b4ed1-b288-4bb5-8d5c-34feca2b9cba None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.394193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b4ed1-b288-4bb5-8d5c-34feca2b9cba None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.394466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b4ed1-b288-4bb5-8d5c-34feca2b9cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.412233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ff1b4ed1-b288-4bb5-8d5c-34feca2b9cba None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:17.414223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ff1b4ed1-b288-4bb5-8d5c-34feca2b9cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:17.430680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e7b3-21f4-4e9a-be62-c6beaafbb94c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.440251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.467848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.468462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.468743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.469014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.469873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:17.470182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:17.471574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:17.482599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 496/971] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:17.483330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.488203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 476/972] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:17.511383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b4ed1-b288-4bb5-8d5c-34feca2b9cba None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.539781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.590666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd0e0-d767-484b-9d65-f4cf5d288225 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.616099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b4ed1-b288-4bb5-8d5c-34feca2b9cba None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.624433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60bc99-6a1a-4b0b-8e8c-1bab88701fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.625046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60bc99-6a1a-4b0b-8e8c-1bab88701fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.625329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60bc99-6a1a-4b0b-8e8c-1bab88701fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.625604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60bc99-6a1a-4b0b-8e8c-1bab88701fc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.626402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60bc99-6a1a-4b0b-8e8c-1bab88701fc1 None admin] RBAC: Adding query filter params (interface=admin, service_id=f735e7f905b645718ba750a06a9a325d, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:17.626713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60bc99-6a1a-4b0b-8e8c-1bab88701fc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:17.628063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60bc99-6a1a-4b0b-8e8c-1bab88701fc1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:17.633058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 497/973] 10.222.0.71 () {56 vars in 1249 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/endpoints?service_id=f735e7f905b645718ba750a06a9a325d&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:17.634239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d24b5-3a72-4d0b-be22-954f7f9cf257 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.634525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d24b5-3a72-4d0b-be22-954f7f9cf257 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.634802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d24b5-3a72-4d0b-be22-954f7f9cf257 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.636154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 498/974] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:17.638953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d24b5-3a72-4d0b-be22-954f7f9cf257 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.654384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef464ebb-1f67-4780-8ae3-ed7b374aa3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.654962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464ebb-1f67-4780-8ae3-ed7b374aa3bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.655248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464ebb-1f67-4780-8ae3-ed7b374aa3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.655523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464ebb-1f67-4780-8ae3-ed7b374aa3bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.666065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef464ebb-1f67-4780-8ae3-ed7b374aa3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ef464ebb-1f67-4780-8ae3-ed7b374aa3bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:17.670947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:17.672085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:17.673165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 477/975] 10.222.0.71 () {56 vars in 1120 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:17.674065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ec3e-a60e-4d8b-b2e7-bfbfc18ff04e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.674065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ec3e-a60e-4d8b-b2e7-bfbfc18ff04e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.674065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ec3e-a60e-4d8b-b2e7-bfbfc18ff04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.679867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.691247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1a92ec3e-a60e-4d8b-b2e7-bfbfc18ff04e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:17.692442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a92ec3e-a60e-4d8b-b2e7-bfbfc18ff04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:17.747229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d24b5-3a72-4d0b-be22-954f7f9cf257 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.759895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 478/976] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:17.760810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92ec3e-a60e-4d8b-b2e7-bfbfc18ff04e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.776915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.796497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.797117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.797397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.797672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.798447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:17.799715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:17.805844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 499/977] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:17.806620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.879420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92ec3e-a60e-4d8b-b2e7-bfbfc18ff04e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.919532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.920166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.920336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.920610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.921345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:17.921706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:17.923186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:17.938002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 479/978] 10.222.0.71 () {56 vars in 1115 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:17.939183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:17.942786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.946614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80571e44-da98-4e64-8579-de4af3311760 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:17.988362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:17.989440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:17.989793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:17.990105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:17.991020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:17.992792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:18.027575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:18.050490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127258f-f006-4fcd-bae4-490ccb36cc5b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:18.067822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 500/979] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:04:17 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:18.109115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:18.109869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:18.110151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:18.110483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:18.122781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:18.124272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:18.142251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:18.143292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:18.144197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:18.144197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:18.144197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:18.144197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:18.145028 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 480/980] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:18.150497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:18.265879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527253-bf93-4fdd-b8b2-bb04fb9fd3cb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:18.300075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:18.300703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:18.300988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:18.301264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:18.301991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:18.302296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:18.304332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:18.316219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 501/981] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:18.322691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:18.424954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e5fb5-a18e-4b33-8af4-032dbf45873a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:18.449009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:18.460925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:18.461682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:18.462085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:18.462463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:18.470299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:18.471842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:18.484323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:18.485911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:04:18.487097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:18.488488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 481/982] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:04:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:18.494224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:18.518863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:18.599373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5bf13-2296-4e7a-b979-a93d40672052 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:18.635142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:18.635755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:18.636033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:18.636307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:18.637091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:18.637397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:18.639005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:18.656380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 502/983] 10.222.0.71 () {56 vars in 1149 bytes} [Tue Aug 2 09:04:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:18.662079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:18.764317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0ed8-25d9-4263-9eb0-3d1afc590ba0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:18.798434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:18.798973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:18.799255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:18.799532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:18.853513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:18.871965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:18.873479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:18.978918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 482/984] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:18 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:18.984851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:19.065363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:19.087693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f411ed-1039-4edf-96e8-738a15daacba None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:19.122799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:19.123436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:19.123722 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:19.124000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:19.134700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:19.136138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:19.150770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:19.151684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:19.152579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:19.152579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:19.152579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:19.152579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:19.153877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 503/985] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:19.158011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:19.249016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:19.264831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e413e2-4558-47f3-862c-74e636b2c6e2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:19.301062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:19.301689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:19.302002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:19.302283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:19.302975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:19.303334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:19.304819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:19.316305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 483/986] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:19.321932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:19.428734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c4085-96e5-41a1-be7f-210272251425 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:19.457132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:19.464198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:19.464835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:19.465117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:19.465392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:19.472002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:19.473627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:19.485829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:19.486903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:19.487813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:19.490100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 504/987] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:19.493314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:19.595349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b6a4-d6af-48ef-9f07-3abb41eb74e8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:19.629493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38d901-c7c8-4d6d-bc2e-f5cee85449d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:19.630135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d901-c7c8-4d6d-bc2e-f5cee85449d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:19.630411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d901-c7c8-4d6d-bc2e-f5cee85449d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:19.630679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d901-c7c8-4d6d-bc2e-f5cee85449d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:19.632126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d901-c7c8-4d6d-bc2e-f5cee85449d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:19.632617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d901-c7c8-4d6d-bc2e-f5cee85449d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:19.634755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d901-c7c8-4d6d-bc2e-f5cee85449d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:19.647039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 484/988] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:19.653087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:19.757286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e277f-3993-4158-b659-ab18ee8a8a67 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:19.792091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf17b0a-d25e-47c8-a92c-6f110929e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:19.792704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf17b0a-d25e-47c8-a92c-6f110929e2ba None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:19.792984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf17b0a-d25e-47c8-a92c-6f110929e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:19.793257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf17b0a-d25e-47c8-a92c-6f110929e2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:19.794070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf17b0a-d25e-47c8-a92c-6f110929e2ba None admin] RBAC: Adding query filter params (role.id=3c2a364fb9a145a9bebc2db236a4d75f, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=15a779d5df5c4df3bac4ef4fa47c5948) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:19.794377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf17b0a-d25e-47c8-a92c-6f110929e2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:19.795785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf17b0a-d25e-47c8-a92c-6f110929e2ba None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:19.809940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 505/989] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:19 2022] GET /identity/v3/role_assignments?user.id=15a779d5df5c4df3bac4ef4fa47c5948&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=3c2a364fb9a145a9bebc2db236a4d75f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:19.855269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b790-a0c0-4020-8d95-fbdd98dca7db None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:19.855518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b790-a0c0-4020-8d95-fbdd98dca7db None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:19.855740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b790-a0c0-4020-8d95-fbdd98dca7db None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:19.857333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 485/990] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:19.864735 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0593e0-86b1-4a02-8946-f5a52513b4d0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:19.865408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0593e0-86b1-4a02-8946-f5a52513b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:19.866641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0593e0-86b1-4a02-8946-f5a52513b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:19.887989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9e0593e0-86b1-4a02-8946-f5a52513b4d0 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:19.889330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9e0593e0-86b1-4a02-8946-f5a52513b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:19.947224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:19.968233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 506/991] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:19.992756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b790-a0c0-4020-8d95-fbdd98dca7db None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:19.997826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:20.095146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd219-cc91-4768-94b6-f62882ebaed3 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.095673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd219-cc91-4768-94b6-f62882ebaed3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.095766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd219-cc91-4768-94b6-f62882ebaed3 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.097319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 507/992] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:20.102285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82be72-66a8-4e77-9bca-f472cc2bd3d9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.102627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82be72-66a8-4e77-9bca-f472cc2bd3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.102971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82be72-66a8-4e77-9bca-f472cc2bd3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.104903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b790-a0c0-4020-8d95-fbdd98dca7db None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.121471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1e82be72-66a8-4e77-9bca-f472cc2bd3d9 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:20.122601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1e82be72-66a8-4e77-9bca-f472cc2bd3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:20.141018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.141654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.141977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.142252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.142872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.144236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:20.153841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:20.154875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:20.155756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 486/993] 10.222.0.71 () {56 vars in 1126 bytes} [Tue Aug 2 09:04:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:20.161119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.199090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 508/994] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:20.220771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82be72-66a8-4e77-9bca-f472cc2bd3d9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.234053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:20.270545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070f661-9954-4a82-b06b-616457b512c6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.307758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.308383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.308662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.308935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.309613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:20.309948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.311730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.322689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 487/995] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:20.323884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.342456 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82be72-66a8-4e77-9bca-f472cc2bd3d9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.358826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:20.379548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.380113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.380398 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.380677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.381837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.383192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:20.392655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:20.393651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:20.394537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 509/996] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:20.399884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.431800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164091-d8f4-449d-bb0c-8b20fb6b2599 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.462167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:20.467752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.468433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.468713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.468987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.469659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:20.469989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.475547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.477105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 488/997] 10.222.0.71 () {56 vars in 1122 bytes} [Tue Aug 2 09:04:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:20.482493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.504603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e462ce-555e-42eb-982d-0eb4e7782855 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.541227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.541952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.542233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.542934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.543611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:20.543910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.545264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.550262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 510/998] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:04:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:20.556495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.596937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff97d-f256-43c7-95ea-826fad1e2a55 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.603173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:20.633304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.633859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.634141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.634415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.635117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.636495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.664051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d166c-1f9f-4d23-bc0e-413ed86219a0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.698382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.699002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.699289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.699566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.700240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:20.700548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.701936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.707168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 511/999] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:04:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:20.713003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.718955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 489/1000] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:20.825271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6918d7-eaf8-4bc3-919e-444b5995e44c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:20.833069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:20.876919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268eadc-cac3-462a-ba85-b12947c949f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:20.877464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268eadc-cac3-462a-ba85-b12947c949f9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:20.881651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268eadc-cac3-462a-ba85-b12947c949f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:20.881651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268eadc-cac3-462a-ba85-b12947c949f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:20.881651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268eadc-cac3-462a-ba85-b12947c949f9 None admin] RBAC: Adding query filter params (interface=public, service_id=de3ca529a1db437d967e2d643a4d616c, region_id=RegionOne) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:20.881651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268eadc-cac3-462a-ba85-b12947c949f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:20.881651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268eadc-cac3-462a-ba85-b12947c949f9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:20.886498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 512/1001] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:04:20 2022] GET /identity/v3/endpoints?service_id=de3ca529a1db437d967e2d643a4d616c&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:20.891544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:20.950421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:20.998703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a3b2-b89c-4116-8ab5-782f1a1b4f45 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:21.033856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17c997-b294-40c4-b6b8-fd75b9aa3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:21.034492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17c997-b294-40c4-b6b8-fd75b9aa3d50 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:21.034762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17c997-b294-40c4-b6b8-fd75b9aa3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:21.035036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17c997-b294-40c4-b6b8-fd75b9aa3d50 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:21.035686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17c997-b294-40c4-b6b8-fd75b9aa3d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:21.037064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17c997-b294-40c4-b6b8-fd75b9aa3d50 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:21.043644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 490/1002] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:04:20 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:04:21.885076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463960b8-21db-4f0d-ab14-a700afbedb09 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:21.885501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463960b8-21db-4f0d-ab14-a700afbedb09 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:21.885663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463960b8-21db-4f0d-ab14-a700afbedb09 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:21.887050 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 513/1003] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:21.892255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a36a59-cb2e-4fdd-858a-1cb2498fb13e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:21.892549 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a36a59-cb2e-4fdd-858a-1cb2498fb13e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:21.892828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a36a59-cb2e-4fdd-858a-1cb2498fb13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:21.911004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-82a36a59-cb2e-4fdd-858a-1cb2498fb13e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:21.912202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-82a36a59-cb2e-4fdd-858a-1cb2498fb13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:21.978652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 491/1004] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:22.000950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463960b8-21db-4f0d-ab14-a700afbedb09 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:22.101730 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463960b8-21db-4f0d-ab14-a700afbedb09 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:22.135976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:22.136535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:22.136817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:22.137091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] PATH_INFO: `/v3/services/image` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:22.137731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:22.139091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:22.148101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:22.149107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:22.150049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:22.153800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 514/1005] 10.222.0.71 () {56 vars in 1105 bytes} [Tue Aug 2 09:04:21 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:22.155409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a36a59-cb2e-4fdd-858a-1cb2498fb13e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:22.207912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:22.259119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a36a59-cb2e-4fdd-858a-1cb2498fb13e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:22.292827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019944c1-d0fa-4d60-bd36-afa40fe52082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:22.293450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019944c1-d0fa-4d60-bd36-afa40fe52082 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:22.293748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019944c1-d0fa-4d60-bd36-afa40fe52082 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:22.294033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019944c1-d0fa-4d60-bd36-afa40fe52082 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:22.294711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019944c1-d0fa-4d60-bd36-afa40fe52082 None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:22.295016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019944c1-d0fa-4d60-bd36-afa40fe52082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:22.296389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019944c1-d0fa-4d60-bd36-afa40fe52082 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:22.301308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 492/1006] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:22.307497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:22.338426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:22.409817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433a33-968c-41ef-b249-55cb9823729d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:22.444929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545c4a6-d02f-4f47-a824-79aa71c053a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:22.445682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c4a6-d02f-4f47-a824-79aa71c053a5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:22.446004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c4a6-d02f-4f47-a824-79aa71c053a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:22.446310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c4a6-d02f-4f47-a824-79aa71c053a5 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:22.446966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545c4a6-d02f-4f47-a824-79aa71c053a5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:22.447278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545c4a6-d02f-4f47-a824-79aa71c053a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:22.448656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545c4a6-d02f-4f47-a824-79aa71c053a5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:22.458921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 515/1007] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:22.790068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8bb5-a27c-497e-b47f-a4faed0ba9d0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:22.790451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8bb5-a27c-497e-b47f-a4faed0ba9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:22.790648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8bb5-a27c-497e-b47f-a4faed0ba9d0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:22.792023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 493/1008] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:22.797406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fd82-62d9-43f5-96a6-4238a31aec53 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:22.797701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fd82-62d9-43f5-96a6-4238a31aec53 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:22.798005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fd82-62d9-43f5-96a6-4238a31aec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:22.815891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-eef6fd82-62d9-43f5-96a6-4238a31aec53 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:22.817062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eef6fd82-62d9-43f5-96a6-4238a31aec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:22.891319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 516/1009] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:22.915100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8bb5-a27c-497e-b47f-a4faed0ba9d0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.025616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8bb5-a27c-497e-b47f-a4faed0ba9d0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.040327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.061270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f6a53-285c-4e32-a535-dca06b98dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.061943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6a53-285c-4e32-a535-dca06b98dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.062235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6a53-285c-4e32-a535-dca06b98dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.062517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6a53-285c-4e32-a535-dca06b98dfc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.063693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f6a53-285c-4e32-a535-dca06b98dfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.065141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f6a53-285c-4e32-a535-dca06b98dfc2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.069985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 494/1010] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:23.074518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6fd82-62d9-43f5-96a6-4238a31aec53 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.099301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.102727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bceba3-9bb8-4e8c-822b-0e15409d597c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.103019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bceba3-9bb8-4e8c-822b-0e15409d597c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.103303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bceba3-9bb8-4e8c-822b-0e15409d597c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.105025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 495/1011] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:23.109800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481218-5234-4dd0-8f4e-a3cc9f1a6874 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.110266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481218-5234-4dd0-8f4e-a3cc9f1a6874 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.110545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481218-5234-4dd0-8f4e-a3cc9f1a6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.129934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-14481218-5234-4dd0-8f4e-a3cc9f1a6874 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:23.131723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14481218-5234-4dd0-8f4e-a3cc9f1a6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:23.183682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6fd82-62d9-43f5-96a6-4238a31aec53 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.217880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 496/1012] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:23.220379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.220998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.221282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.221560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.222288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.223720 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.234852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481218-5234-4dd0-8f4e-a3cc9f1a6874 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.333839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 517/1013] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:04:23 2022] POST /identity/v3/projects => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:23.346657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481218-5234-4dd0-8f4e-a3cc9f1a6874 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.362668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.385943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.386618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.386897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.387170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.387816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.389258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:23.399931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:23.401118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:23.402976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 497/1014] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:23.407671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.512201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:23.536300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709ffd7-6f21-4366-b30a-bda998487e64 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.573998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.574644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.574932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.575208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.575902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:23.576212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.577610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.584729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 518/1015] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:04:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:23.589852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.694231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e0e4-aaae-4065-ab91-25f1b7fe0470 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.729301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb291556-39f8-42a7-9e29-cfcc38089ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.729948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb291556-39f8-42a7-9e29-cfcc38089ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.730234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb291556-39f8-42a7-9e29-cfcc38089ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.730511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb291556-39f8-42a7-9e29-cfcc38089ce1 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.731285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb291556-39f8-42a7-9e29-cfcc38089ce1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:23.731602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb291556-39f8-42a7-9e29-cfcc38089ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.732978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb291556-39f8-42a7-9e29-cfcc38089ce1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.738114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 498/1016] 10.222.0.71 () {56 vars in 1112 bytes} [Tue Aug 2 09:04:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:23.745006 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:23.852955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90866b73-277d-4377-8776-c4f1b73a47ee None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:23.898009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9fe1-4ca0-4d7c-8309-73a88664a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:23.898639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9fe1-4ca0-4d7c-8309-73a88664a197 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:23.898984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9fe1-4ca0-4d7c-8309-73a88664a197 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:23.899183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9fe1-4ca0-4d7c-8309-73a88664a197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:23.899857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb9fe1-4ca0-4d7c-8309-73a88664a197 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:23.901214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb9fe1-4ca0-4d7c-8309-73a88664a197 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:23.910633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:24.015776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 519/1017] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:24.476965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce3da-9e89-477a-b0db-e16f9336b91a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.477515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce3da-9e89-477a-b0db-e16f9336b91a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.477515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce3da-9e89-477a-b0db-e16f9336b91a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.479139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 499/1018] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:24.484347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66a55-765b-4e50-bd5a-66d6b19c11b5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.484643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66a55-765b-4e50-bd5a-66d6b19c11b5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.484925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66a55-765b-4e50-bd5a-66d6b19c11b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.504540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4fa66a55-765b-4e50-bd5a-66d6b19c11b5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:24.505802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4fa66a55-765b-4e50-bd5a-66d6b19c11b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:24.586245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 520/1019] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:24 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:24.608308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce3da-9e89-477a-b0db-e16f9336b91a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:24.652976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:24.713208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce3da-9e89-477a-b0db-e16f9336b91a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:24.746791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e15480-49af-4a6f-a28d-f8e9e9621d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:24.747333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15480-49af-4a6f-a28d-f8e9e9621d44 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:24.747614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15480-49af-4a6f-a28d-f8e9e9621d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:24.747895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15480-49af-4a6f-a28d-f8e9e9621d44 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:24.748591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15480-49af-4a6f-a28d-f8e9e9621d44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:24.749993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15480-49af-4a6f-a28d-f8e9e9621d44 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:24.891501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 500/1020] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:04:24 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:25.416380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a0b85-b9f7-46f7-bd4d-3e130e5a9608 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.416948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a0b85-b9f7-46f7-bd4d-3e130e5a9608 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.416948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a0b85-b9f7-46f7-bd4d-3e130e5a9608 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.418359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 521/1021] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:25.423416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce9f2-8463-40a5-ac17-c17e20bb54e2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.423714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce9f2-8463-40a5-ac17-c17e20bb54e2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.423998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce9f2-8463-40a5-ac17-c17e20bb54e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.441952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-236ce9f2-8463-40a5-ac17-c17e20bb54e2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:25.443141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-236ce9f2-8463-40a5-ac17-c17e20bb54e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:25.517971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 501/1022] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:25.542502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a0b85-b9f7-46f7-bd4d-3e130e5a9608 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.647357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a0b85-b9f7-46f7-bd4d-3e130e5a9608 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.671161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:25.683521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a133e-2df4-47cb-946e-07727d90efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.697047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a133e-2df4-47cb-946e-07727d90efaf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.697047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a133e-2df4-47cb-946e-07727d90efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.697047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a133e-2df4-47cb-946e-07727d90efaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.697047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a133e-2df4-47cb-946e-07727d90efaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.697047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a133e-2df4-47cb-946e-07727d90efaf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.697047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 522/1023] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:25.697564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ce9f2-8463-40a5-ac17-c17e20bb54e2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:25.723560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:25.799057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ce9f2-8463-40a5-ac17-c17e20bb54e2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:25.833125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb579-eaf3-479c-9f70-54750389496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:25.833765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb579-eaf3-479c-9f70-54750389496a None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:25.834048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb579-eaf3-479c-9f70-54750389496a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:25.834984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb579-eaf3-479c-9f70-54750389496a None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:25.835613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fb579-eaf3-479c-9f70-54750389496a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:25.837059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fb579-eaf3-479c-9f70-54750389496a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:25.948424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 502/1024] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:04:25 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:26.149142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee1d0-b0cf-4ce9-90df-f5b4c3aeb40b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.149429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee1d0-b0cf-4ce9-90df-f5b4c3aeb40b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.149696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee1d0-b0cf-4ce9-90df-f5b4c3aeb40b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.151090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 523/1025] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:26.156188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecec9e-f80d-4998-b8d8-6ba680527942 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.156476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecec9e-f80d-4998-b8d8-6ba680527942 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.156757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecec9e-f80d-4998-b8d8-6ba680527942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.175763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c9ecec9e-f80d-4998-b8d8-6ba680527942 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:26.177188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c9ecec9e-f80d-4998-b8d8-6ba680527942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:26.249659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 503/1026] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:26.272386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dee1d0-b0cf-4ce9-90df-f5b4c3aeb40b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:26.378877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dee1d0-b0cf-4ce9-90df-f5b4c3aeb40b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:26.414450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:26.415086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.415365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.415639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.425702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:26.431670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:26.432609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:26.433460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:26.437830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 524/1027] 10.222.0.71 () {56 vars in 1120 bytes} [Tue Aug 2 09:04:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:26.438834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecec9e-f80d-4998-b8d8-6ba680527942 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:26.453414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:26.541697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecec9e-f80d-4998-b8d8-6ba680527942 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:26.579962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:26.580583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.580863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.581135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.581878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:26.582181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:26.583535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:26.596792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 504/1028] 10.222.0.71 () {56 vars in 1115 bytes} [Tue Aug 2 09:04:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:26.597797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:26.652059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:26.703022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715acb84-5749-411c-a87b-bc8166d8297f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:26.738863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:26.739499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.739780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.740063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.750918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:26.752344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:26.767675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:26.768603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:26.774334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:26.774334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:26.774334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:26.774334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:26.774334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 525/1029] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:26.774950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:26.855545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:26.883399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc93e-3545-4c51-b885-2ff099c3bf59 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:26.917770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4816fd-ade4-4688-acde-9bb7ddd53bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:26.918395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4816fd-ade4-4688-acde-9bb7ddd53bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.918675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4816fd-ade4-4688-acde-9bb7ddd53bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.918949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4816fd-ade4-4688-acde-9bb7ddd53bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.919646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4816fd-ade4-4688-acde-9bb7ddd53bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:26.919951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4816fd-ade4-4688-acde-9bb7ddd53bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:26.921315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4816fd-ade4-4688-acde-9bb7ddd53bd2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:26.938626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 505/1030] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:26.939913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:26.953259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0976-5760-4385-b692-bbde05dff4cc None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.953556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0976-5760-4385-b692-bbde05dff4cc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.954032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0976-5760-4385-b692-bbde05dff4cc None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.955613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 506/1031] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:26.960196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee7675-3cf2-4a33-94aa-8c6ef2e283d2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:26.960481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee7675-3cf2-4a33-94aa-8c6ef2e283d2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:26.960758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee7675-3cf2-4a33-94aa-8c6ef2e283d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:26.979817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b9ee7675-3cf2-4a33-94aa-8c6ef2e283d2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:26.981013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b9ee7675-3cf2-4a33-94aa-8c6ef2e283d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:27.049676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66c73f-b4cd-4ecf-a3f9-54483bb07a4a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.051240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.055316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 507/1032] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:27.078075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee7675-3cf2-4a33-94aa-8c6ef2e283d2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.087409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.088291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.088757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.089240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.097138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.098829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:27.114019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:27.114991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:04:27.116143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:27.118434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 526/1033] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:04:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:27.123687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.151724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.189250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee7675-3cf2-4a33-94aa-8c6ef2e283d2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.226117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.226766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.227051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.227326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] PATH_INFO: `/v3/services/image` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.228004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.229397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:27.238386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:27.239385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:27.240258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 508/1034] 10.222.0.71 () {56 vars in 1105 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:27.243748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35fcd8-49e6-45d2-adf0-c61f51ad3fbd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.245696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.281578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.282223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.282502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.282788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.283600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:27.283903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.285310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.304009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 527/1035] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:27.309457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.332096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.356676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e52a59-611a-41b3-be4e-e4c31f476e62 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.385828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.394230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.399123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.399123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.399123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.399123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:27.399123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.399123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.403139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 509/1036] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:27.408920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.416518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc2106-b4a1-4065-bf7a-49c5d24828da None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.452571 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.453193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.453465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.453762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.523369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edd943-931b-40df-9e82-a0a4c74674c2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.528419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.529887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.553632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.559511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289de861-9045-4079-931e-a79e219c8929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.560195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289de861-9045-4079-931e-a79e219c8929 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.560452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289de861-9045-4079-931e-a79e219c8929 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.560738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289de861-9045-4079-931e-a79e219c8929 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.561415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289de861-9045-4079-931e-a79e219c8929 None admin] RBAC: Adding query filter params (type=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:27.561761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289de861-9045-4079-931e-a79e219c8929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.567624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289de861-9045-4079-931e-a79e219c8929 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.568189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 510/1037] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:27.575248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289de861-9045-4079-931e-a79e219c8929 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.635576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.650886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 528/1038] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:27.651747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.682542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289de861-9045-4079-931e-a79e219c8929 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.719620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.720249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.720534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.720816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.721575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] RBAC: Adding query filter params (interface=public, service_id=d29aa3faff3d4a7d8d901a9efc54571f, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:27.721921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.723297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.730040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 511/1039] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/endpoints?service_id=d29aa3faff3d4a7d8d901a9efc54571f&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:27.735514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.761658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201164-587f-42d5-8bfd-8d1407872e0c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.785408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.800081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.800727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.807962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.807962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.812340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.813877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:27.829172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:27.830164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:27.831068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:27.831068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:27.831068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:27.831068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:27.831068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 529/1040] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:27.838804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:27.845074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755fede-87ca-4c50-97a1-8023c5d1abc7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.872856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:27.889585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.890394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.890678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.890984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.891642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.893016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:27.937002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 512/1041] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/services => generated 1957 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:04:27.947324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030773ac-a983-4ccd-9cdb-f7db06fba38a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:27.985463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90720677-6290-4898-a226-a890c6f77dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:27.986202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720677-6290-4898-a226-a890c6f77dda None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:27.986491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720677-6290-4898-a226-a890c6f77dda None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:27.986770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720677-6290-4898-a226-a890c6f77dda None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:27.987488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90720677-6290-4898-a226-a890c6f77dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:27.987794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90720677-6290-4898-a226-a890c6f77dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:27.989241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90720677-6290-4898-a226-a890c6f77dda None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:28.007838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 530/1042] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:28.009415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:28.059336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a506f3-2685-4eec-800e-bd3b465543d1 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.059690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a506f3-2685-4eec-800e-bd3b465543d1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.059885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a506f3-2685-4eec-800e-bd3b465543d1 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.061389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 531/1043] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:28.066782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed75ecc-d4d5-48ad-9e31-74a16c02bdff None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.067072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed75ecc-d4d5-48ad-9e31-74a16c02bdff None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.067350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed75ecc-d4d5-48ad-9e31-74a16c02bdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.087746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5ed75ecc-d4d5-48ad-9e31-74a16c02bdff None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:28.089022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5ed75ecc-d4d5-48ad-9e31-74a16c02bdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:28.122935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fc244-87d4-4739-9d80-8c807cb0f5e8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:28.123156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:28.159135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:28.159779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.160062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.160340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.167414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 532/1044] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:28.167908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:28.169441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:28.180987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:28.182176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:28.187849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 513/1045] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:28.188387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed75ecc-d4d5-48ad-9e31-74a16c02bdff None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:28.191794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:28.239786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:28.299545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29bdd-1204-4973-8687-02c89019a665 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:28.301944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed75ecc-d4d5-48ad-9e31-74a16c02bdff None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:28.335920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:28.336594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.336879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.337162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.337467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:28.338107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.338388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.338662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.339521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:28.339951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:28.341357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:28.347956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:28.359365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 533/1046] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:28.359533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:28.360446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:28.361296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 514/1047] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:28.362058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:28.362186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:28.391825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:28.468727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62caa9-4191-4d64-9881-d1eacad936aa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:28.471566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafbc44-1f3e-49a5-93e7-05f5df52d89c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:28.474026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:28.503447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:28.504316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.504657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.505209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.506785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] RBAC: Adding query filter params (role.id=3c2a364fb9a145a9bebc2db236a4d75f, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8771927999ea4471a4673dead83336e5) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:28.507098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:28.508513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:28.508633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:28.509211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.509563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.509941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.510663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:28.511024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:28.512416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:28.514593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 534/1048] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:28 2022] GET /identity/v3/role_assignments?user.id=8771927999ea4471a4673dead83336e5&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=3c2a364fb9a145a9bebc2db236a4d75f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:28.526284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 515/1049] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:28.532072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:28.628507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:28.645887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe46b-7a41-4aa0-a96d-db9920825e0a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:28.688234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:28.688877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.689156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.689430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] PATH_INFO: `/v3/users/ec515b8c67d2443eaff341d70a2c4704` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.704472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] RBAC: Authorizing `identity:get_user(user_id=ec515b8c67d2443eaff341d70a2c4704)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:28.705924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:28.707600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 535/1050] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:28 2022] GET /identity/v3/users/ec515b8c67d2443eaff341d70a2c4704 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:28.713954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:28.822203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b6d8-399a-4e0b-893b-83012f74e4f9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:28.857493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:28.858139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:28.858415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:28.858687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:28.903103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:28.938072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:28.939537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:29.040176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 516/1051] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:04:29.045810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:29.152074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c5537-43b0-4a62-8f2f-5c8447a1cb76 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:29.187138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd80c5-48eb-48e5-b553-9f1ec80a1cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:29.187790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd80c5-48eb-48e5-b553-9f1ec80a1cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:29.188076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd80c5-48eb-48e5-b553-9f1ec80a1cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:29.188358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd80c5-48eb-48e5-b553-9f1ec80a1cf1 None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:29.189627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd80c5-48eb-48e5-b553-9f1ec80a1cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=c124224d675f45c7868d40b8ed4ce72c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:29.191094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd80c5-48eb-48e5-b553-9f1ec80a1cf1 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:29.192986 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 536/1052] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:29 2022] GET /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:29.199522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:29.265588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:29.299466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd20408-1ab2-44ab-bdfa-4d4706f6da22 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:29.334694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe15652-d495-4edd-afe2-e94138e06e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:29.335314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15652-d495-4edd-afe2-e94138e06e82 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:29.335595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15652-d495-4edd-afe2-e94138e06e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:29.335871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15652-d495-4edd-afe2-e94138e06e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:29.336655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15652-d495-4edd-afe2-e94138e06e82 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=c124224d675f45c7868d40b8ed4ce72c, user.id=ec515b8c67d2443eaff341d70a2c4704) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:29.336965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15652-d495-4edd-afe2-e94138e06e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:29.338419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15652-d495-4edd-afe2-e94138e06e82 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:29.344082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 517/1053] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:29 2022] GET /identity/v3/role_assignments?user.id=ec515b8c67d2443eaff341d70a2c4704&scope.project.id=c124224d675f45c7868d40b8ed4ce72c&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:30.032722 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77746fd-d3d6-4610-8f25-455a3dde4b31 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.033272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77746fd-d3d6-4610-8f25-455a3dde4b31 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.033272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77746fd-d3d6-4610-8f25-455a3dde4b31 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.034845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 537/1054] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:30.040306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac44d-53b2-46b6-a1cb-0d6cfca408d6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.040711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac44d-53b2-46b6-a1cb-0d6cfca408d6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.040885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac44d-53b2-46b6-a1cb-0d6cfca408d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.059076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5faac44d-53b2-46b6-a1cb-0d6cfca408d6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:30.060275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5faac44d-53b2-46b6-a1cb-0d6cfca408d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:30.128182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 518/1055] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:30.150726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77746fd-d3d6-4610-8f25-455a3dde4b31 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:30.166285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:30.256720 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77746fd-d3d6-4610-8f25-455a3dde4b31 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:30.291840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:30.292481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.292768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.293047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] PATH_INFO: `/v3/services/image` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.293676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:30.295066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:30.304464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:30.305470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:04:30.306376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:30.310071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 538/1056] 10.222.0.71 () {56 vars in 1105 bytes} [Tue Aug 2 09:04:30 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:30.311604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faac44d-53b2-46b6-a1cb-0d6cfca408d6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:30.371449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:30.414810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faac44d-53b2-46b6-a1cb-0d6cfca408d6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:30.451632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3114316-9382-4c30-9f94-ffa5f69ad1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:30.452260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114316-9382-4c30-9f94-ffa5f69ad1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.452544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114316-9382-4c30-9f94-ffa5f69ad1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.452821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114316-9382-4c30-9f94-ffa5f69ad1d5 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.453497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3114316-9382-4c30-9f94-ffa5f69ad1d5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:30.453833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3114316-9382-4c30-9f94-ffa5f69ad1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:30.455207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3114316-9382-4c30-9f94-ffa5f69ad1d5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:30.461076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 519/1057] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:30.466609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:30.503990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12cec-6049-49f7-a8d5-d2954b3fa4ea None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.504296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12cec-6049-49f7-a8d5-d2954b3fa4ea None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.504548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12cec-6049-49f7-a8d5-d2954b3fa4ea None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.506078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 520/1058] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:30.510839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e5bc5-6bf3-4f75-a836-d82d5d479297 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.511120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e5bc5-6bf3-4f75-a836-d82d5d479297 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.511392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e5bc5-6bf3-4f75-a836-d82d5d479297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.530511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-104e5bc5-6bf3-4f75-a836-d82d5d479297 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:30.531713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-104e5bc5-6bf3-4f75-a836-d82d5d479297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:30.553646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:30.582366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ea944-2505-4faa-bc9c-5f844f99a075 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:30.604685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 521/1059] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:30.621046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:30.621663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.622047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.622324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.622998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:30.623303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:30.624667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:30.627316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e5bc5-6bf3-4f75-a836-d82d5d479297 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:30.634305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 539/1060] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:30.636423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:30.690784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:30.738197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e5bc5-6bf3-4f75-a836-d82d5d479297 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:30.742072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e285d-244a-41ed-9533-d59c09f931f8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:30.774160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:30.774835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.775085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.775374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.777862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:30.778481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.778766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.779045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.779754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:30.781110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:30.785940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:30.790593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:30.790855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:30.791989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:30.792850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 522/1061] 10.222.0.71 () {56 vars in 1120 bytes} [Tue Aug 2 09:04:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:30.797987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:30.863924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 540/1062] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:04:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:30.914503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76079d12-a18d-498f-acc6-f87c8292b9b6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:30.931061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:30.962159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:30.962707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:30.962989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:30.963264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:30.964004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:30.964309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:30.965703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:30.975534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 523/1063] 10.222.0.71 () {56 vars in 1115 bytes} [Tue Aug 2 09:04:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:30.981116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.090379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b585aca-68c4-44bc-9f1f-9da503b93f68 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.124716 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.125354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.125632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.125933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.139463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.140961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:31.155375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:31.156306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:31.157234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:31.157234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:31.157234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:31.157234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:31.157234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 541/1064] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:31.162893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.264786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b787eb-1d86-4e2f-a5b2-3b5d466d4bbf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.297641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499ee08-aa2f-4020-8097-9bd1309e144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.298301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ee08-aa2f-4020-8097-9bd1309e144b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.298579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ee08-aa2f-4020-8097-9bd1309e144b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.298854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ee08-aa2f-4020-8097-9bd1309e144b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.299542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499ee08-aa2f-4020-8097-9bd1309e144b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:31.299846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499ee08-aa2f-4020-8097-9bd1309e144b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.301216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499ee08-aa2f-4020-8097-9bd1309e144b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.314046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 524/1065] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:31.320340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.353627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6a06-b364-4128-8a92-0973f7986695 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.353960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6a06-b364-4128-8a92-0973f7986695 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.354217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6a06-b364-4128-8a92-0973f7986695 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.355709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 525/1066] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:31.360588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60e0e8-956a-4984-9ae1-11fbb6f7cce6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.360884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60e0e8-956a-4984-9ae1-11fbb6f7cce6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.361166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60e0e8-956a-4984-9ae1-11fbb6f7cce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.372999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:31.379478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4c60e0e8-956a-4984-9ae1-11fbb6f7cce6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:31.380669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4c60e0e8-956a-4984-9ae1-11fbb6f7cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:31.408276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:31.430388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e832c2-d6ee-4351-9e38-5b86a6d11fa2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.451860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 526/1067] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:31.468156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.468800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.469085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.469423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.473489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60e0e8-956a-4984-9ae1-11fbb6f7cce6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.478153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.479609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:31.491374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:31.492567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:31.493529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 542/1068] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:31.498478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.582370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60e0e8-956a-4984-9ae1-11fbb6f7cce6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.609556 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078ead-f3b2-40bf-a68d-97713a77f065 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.619511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:31.620784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.621450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.621748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.622052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.632523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:31.637555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:31.638545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:31.639409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:31.643599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 527/1069] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:31.644872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.647819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.648452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.649289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.649927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.650818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:31.651204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.653166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.672147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 543/1070] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:31.678330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.679544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:31.757267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df325-1081-4cca-8071-3427b0fc9b97 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.781106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273250b-7dc7-4d05-a546-5a2cdb0aa747 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.794384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.795002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.795285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.795562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.796280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:31.796584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.797997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.806892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 528/1071] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:31.812567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.824346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.824991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.825280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.825557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.836653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.838097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:31.853012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:31.854265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:31.855171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:31.855171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:31.855171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:31.855171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:31.855171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 544/1072] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:31.859929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:31.884801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:31.917017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:31.934052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf8c0f-8163-4417-a285-1ce2237ab6ea None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.970434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebd374-0d32-4e50-8db3-a31312e1e237 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:31.970661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:31.971457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:31.971984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:31.972606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] PATH_INFO: `/v3/users/ec515b8c67d2443eaff341d70a2c4704` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:31.978477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] RBAC: Authorizing `identity:get_user(user_id=ec515b8c67d2443eaff341d70a2c4704)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:31.979935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:31.981666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 529/1073] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/users/ec515b8c67d2443eaff341d70a2c4704 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:31.987389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.011608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.012248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.012531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.013250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.013529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:32.013862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.015277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.033691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 545/1074] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:32.034767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.097783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae6e13-380f-4072-97f5-569ca74b0f73 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.120133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.136732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.137381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.137870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.138001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.139118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] RBAC: Authorizing `identity:get_project(project_id=c124224d675f45c7868d40b8ed4ce72c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.140589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.147830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 530/1075] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:31 2022] GET /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:32.147972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e17a8-3cb7-4a50-a438-de5c86cc82bc None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.149389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.177803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.179798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.180437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.180726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.181007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.188301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.189756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:32.201948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:32.202871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:32.203818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:32.206054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 546/1076] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:32.208687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.264095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e593ea-0638-426b-8dcf-56776649ba1d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.299617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210f03d-3101-48a7-9f3c-c253813dd088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.300531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210f03d-3101-48a7-9f3c-c253813dd088 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.300895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210f03d-3101-48a7-9f3c-c253813dd088 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.301268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210f03d-3101-48a7-9f3c-c253813dd088 None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c/users/ec515b8c67d2443eaff341d70a2c4704/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.303592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210f03d-3101-48a7-9f3c-c253813dd088 None admin] RBAC: Authorizing `identity:create_grant(project_id=c124224d675f45c7868d40b8ed4ce72c, user_id=ec515b8c67d2443eaff341d70a2c4704, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.305270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210f03d-3101-48a7-9f3c-c253813dd088 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.314622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc0f0c-2a1b-47de-99c3-77216865342c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.348870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.349412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.350022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.350296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.351047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:32.351357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.352785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.359907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:32.365117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 547/1077] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:32.371528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:32.375637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 531/1078] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:04:32 2022] PUT /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c/users/ec515b8c67d2443eaff341d70a2c4704/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:04:32.485056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ec24-6530-44f6-8844-89fc83221087 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:32.525892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c095a-6e77-4f38-8d71-d3fddf2d692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:32.525892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c095a-6e77-4f38-8d71-d3fddf2d692a None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.526198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c095a-6e77-4f38-8d71-d3fddf2d692a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.526581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c095a-6e77-4f38-8d71-d3fddf2d692a None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8771927999ea4471a4673dead83336e5/roles/3c2a364fb9a145a9bebc2db236a4d75f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.530517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c095a-6e77-4f38-8d71-d3fddf2d692a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=8771927999ea4471a4673dead83336e5, role_id=3c2a364fb9a145a9bebc2db236a4d75f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:32.531672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c095a-6e77-4f38-8d71-d3fddf2d692a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:32.591211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 548/1079] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:04:32 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/8771927999ea4471a4673dead83336e5/roles/3c2a364fb9a145a9bebc2db236a4d75f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:32.938018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbc2e0-5c67-4f08-a252-7b56aa44e186 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.938365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbc2e0-5c67-4f08-a252-7b56aa44e186 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.938582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbc2e0-5c67-4f08-a252-7b56aa44e186 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.939997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 532/1080] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:32.945201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafd53-5757-4bf9-8a35-0bc320dee155 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:32.945484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafd53-5757-4bf9-8a35-0bc320dee155 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:32.945786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafd53-5757-4bf9-8a35-0bc320dee155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:32.963577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-34aafd53-5757-4bf9-8a35-0bc320dee155 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:32.964789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-34aafd53-5757-4bf9-8a35-0bc320dee155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:33.021140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:33.035662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 549/1081] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:33.058438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbc2e0-5c67-4f08-a252-7b56aa44e186 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.143544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:33.165164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbc2e0-5c67-4f08-a252-7b56aa44e186 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.199948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.200578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.200821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.201097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.277302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.278790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.358748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:33.379211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 533/1082] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:33.385575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafd53-5757-4bf9-8a35-0bc320dee155 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.486384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafd53-5757-4bf9-8a35-0bc320dee155 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.524511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9feffb-7dcc-4df9-a28e-b19b8c4e3244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.525140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9feffb-7dcc-4df9-a28e-b19b8c4e3244 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.525427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9feffb-7dcc-4df9-a28e-b19b8c4e3244 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.525700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9feffb-7dcc-4df9-a28e-b19b8c4e3244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.535629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9feffb-7dcc-4df9-a28e-b19b8c4e3244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.537140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9feffb-7dcc-4df9-a28e-b19b8c4e3244 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0c9feffb-7dcc-4df9-a28e-b19b8c4e3244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:33.552442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:33.554046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:33.554968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:33.554968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:33.554968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:33.554968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:33.558054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 550/1083] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:33.560641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:33.664559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113eb1a-d8a7-4553-9f6f-d006df04a666 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:33.699398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b163f9-0ea9-4d2d-874f-c9dff68a403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:33.700036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b163f9-0ea9-4d2d-874f-c9dff68a403b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:33.700316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b163f9-0ea9-4d2d-874f-c9dff68a403b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:33.700588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b163f9-0ea9-4d2d-874f-c9dff68a403b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:33.701289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b163f9-0ea9-4d2d-874f-c9dff68a403b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:33.701591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b163f9-0ea9-4d2d-874f-c9dff68a403b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:33.703026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b163f9-0ea9-4d2d-874f-c9dff68a403b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:33.721757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 534/1084] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:34.395614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ae688-0e05-4ca4-b994-facdc7baf36c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.396146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ae688-0e05-4ca4-b994-facdc7baf36c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.396146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ae688-0e05-4ca4-b994-facdc7baf36c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.398235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 551/1085] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:34.403203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f085-24be-46ed-b619-24496bab96bd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.403619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f085-24be-46ed-b619-24496bab96bd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.403754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f085-24be-46ed-b619-24496bab96bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.422128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d3f8f085-24be-46ed-b619-24496bab96bd None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:34.423309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d3f8f085-24be-46ed-b619-24496bab96bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.457075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:34.490727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 535/1086] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:34.514631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ae688-0e05-4ca4-b994-facdc7baf36c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.558242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:34.599396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ffd5f-76eb-4816-828c-ab21bf1ef33c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.600132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ffd5f-76eb-4816-828c-ab21bf1ef33c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.600436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ffd5f-76eb-4816-828c-ab21bf1ef33c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.602009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 536/1087] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:04:34.606581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0450-3699-41bc-b64e-4fd90ebbd64e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.606868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0450-3699-41bc-b64e-4fd90ebbd64e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.607149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0450-3699-41bc-b64e-4fd90ebbd64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.617220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ae688-0e05-4ca4-b994-facdc7baf36c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.624920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-882c0450-3699-41bc-b64e-4fd90ebbd64e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:34.626159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-882c0450-3699-41bc-b64e-4fd90ebbd64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:34.652654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.653215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.653496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.653883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.663995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:34.668851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:34.669821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:34.670804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 552/1088] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:34.676331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.692083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 537/1089] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:04:34.716238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c0450-3699-41bc-b64e-4fd90ebbd64e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.774150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:34.777762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518f1f-3fdd-46bc-8c94-52276694ddc3 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.811488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:34.811893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.812510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.812800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.813080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.813822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:34.814132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:34.814316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c0450-3699-41bc-b64e-4fd90ebbd64e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.815503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:34.824250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 553/1090] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:34.830004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.851996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:34.852650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:34.853038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:34.853210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:34.863648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:34.869234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:34.870274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:34.871661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 538/1091] 10.222.0.71 () {56 vars in 1120 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:34.876385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:34.992722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12997e9e-ede7-4f62-acd5-ecefd838c785 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:34.993762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9661-3a5d-4931-8fce-f4c0e51f0138 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.025859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.026469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.026748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.026957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.027067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.027593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.027712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:35.027878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.028015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.028162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] PATH_INFO: `/v3/users/ec515b8c67d2443eaff341d70a2c4704` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.029347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] RBAC: Authorizing `identity:get_user(user_id=ec515b8c67d2443eaff341d70a2c4704)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.029449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.030802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.032417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 554/1092] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/users/ec515b8c67d2443eaff341d70a2c4704 => generated 285 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:35.037588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 539/1093] 10.222.0.71 () {56 vars in 1115 bytes} [Tue Aug 2 09:04:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:35.038132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.043398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.067838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.071617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.142614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deb1b8-0769-4fbc-bca2-e3c48883daf9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.143902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6e08-8584-44bb-9226-fab90a96a285 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.178443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.179258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.179539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.179818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.179923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.180453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.180738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.181015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.190249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.191711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:35.205517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:35.206462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:35.207371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:35.207371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:35.207371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:35.207371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:35.207371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 540/1094] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:35.212467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.251763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.253136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.282016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.286351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.311498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231e66-ca90-4d95-8bbc-f01b31562ce2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.344719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.345332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.345608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.345919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.346602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:35.346936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.348305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.352799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 555/1095] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:04:35.358681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.361181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 541/1096] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:35.367171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.457446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6313932-657e-4ea0-aaf7-1b9791b1066a None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.465708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbdc8b-cd12-4b4e-94b3-3c0abba9b9f5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.487543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.494047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.494690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.494978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.495257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.496425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] RBAC: Authorizing `identity:get_project(project_id=c124224d675f45c7868d40b8ed4ce72c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.497886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.499554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 556/1097] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:35.500860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.501499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.502740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.502740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.504133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.505772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.510293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.511742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:04:35.524094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:35.525192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:35.526622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 542/1098] 10.222.0.71 () {56 vars in 1093 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:04:35.530931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.619808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58933e-52cc-4ab7-8cf0-41ccebdf160b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.638708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf41a-b565-4ce1-aeaa-fac7d9a6f881 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.653290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.653945 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.654229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.654509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.655289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=c124224d675f45c7868d40b8ed4ce72c, user.id=ec515b8c67d2443eaff341d70a2c4704) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:35.655606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.657026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.662876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 557/1099] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/role_assignments?user.id=ec515b8c67d2443eaff341d70a2c4704&scope.project.id=c124224d675f45c7868d40b8ed4ce72c&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:35.671835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.672470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.672748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.673020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.673874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:35.674181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.675657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.700788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 543/1100] 10.222.0.71 () {56 vars in 1133 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:35.706576 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:35.772543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:35.813961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcebf26-d440-42d5-84fd-03401741af96 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:35.848234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:35.848855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:35.849143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:35.849446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:35.921173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:35.922675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:35.982449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:36.022108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 558/1101] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:04:36.028136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:36.080804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:36.127135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afe9c2-aecc-42ab-a73a-efa947ad9d82 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:36.160513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:36.161159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:36.161438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:36.161709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:36.172608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:36.174087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:04:36.189208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:36.190157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:36.191115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:04:36.191115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:04:36.191115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:04:36.191115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:36.191115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 544/1102] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:36.196115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:36.298618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ea0a-c0e3-411b-a318-97d74d872515 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:36.331726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:36.332342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:36.332624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:36.332898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:36.333582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:36.334437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:36.335799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:36.346910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 559/1103] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:36.353360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:36.450312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4c69-1866-40a7-b8a6-863fef3f4801 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:36.452589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:36.484369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:36.485007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:36.485267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:36.485540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:36.492069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:36.493519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:04:36.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:36.506630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:04:36.507546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 545/1104] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:36.512092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:36.538497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:36.613799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14891b1-7bee-426d-9fe1-c661781ad5f4 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:36.646915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d84b-5b41-4cf1-b7d4-9a4253d2b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:36.647525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d84b-5b41-4cf1-b7d4-9a4253d2b828 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:36.647809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d84b-5b41-4cf1-b7d4-9a4253d2b828 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:36.648085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d84b-5b41-4cf1-b7d4-9a4253d2b828 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:36.648828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d84b-5b41-4cf1-b7d4-9a4253d2b828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:36.649135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d84b-5b41-4cf1-b7d4-9a4253d2b828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:36.650591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d84b-5b41-4cf1-b7d4-9a4253d2b828 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:36.662845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 560/1105] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:36.670107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:36.768499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02769204-7301-440f-9462-d09a01a77c6a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:36.802272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a6b15-f8cf-4d25-a786-1a44c1761181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:36.803570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a6b15-f8cf-4d25-a786-1a44c1761181 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:36.803857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a6b15-f8cf-4d25-a786-1a44c1761181 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:36.804136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a6b15-f8cf-4d25-a786-1a44c1761181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:36.804948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a6b15-f8cf-4d25-a786-1a44c1761181 None admin] RBAC: Adding query filter params (role.id=3c2a364fb9a145a9bebc2db236a4d75f, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=8771927999ea4471a4673dead83336e5) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:36.805267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a6b15-f8cf-4d25-a786-1a44c1761181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:36.806783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a6b15-f8cf-4d25-a786-1a44c1761181 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:36.825753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 546/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:36 2022] GET /identity/v3/role_assignments?user.id=8771927999ea4471a4673dead83336e5&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=3c2a364fb9a145a9bebc2db236a4d75f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:37.741470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678ad2-8e6c-4346-a68b-6d38cf24a20d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:37.742090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678ad2-8e6c-4346-a68b-6d38cf24a20d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:37.742090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678ad2-8e6c-4346-a68b-6d38cf24a20d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:37.743432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 561/1107] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:37.748729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cefdf1-0bed-431b-937f-9612869cc890 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:37.749122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cefdf1-0bed-431b-937f-9612869cc890 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:37.749282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cefdf1-0bed-431b-937f-9612869cc890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:37.767370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-21cefdf1-0bed-431b-937f-9612869cc890 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:37.768564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-21cefdf1-0bed-431b-937f-9612869cc890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:37.792005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:37.835442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 547/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:37.860210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e678ad2-8e6c-4346-a68b-6d38cf24a20d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:37.942438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:37.961818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e678ad2-8e6c-4346-a68b-6d38cf24a20d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:37.995807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7287ab6-de6a-4602-9db8-4945e4fb0a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:37.996371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287ab6-de6a-4602-9db8-4945e4fb0a81 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:37.996650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287ab6-de6a-4602-9db8-4945e4fb0a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:37.996919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287ab6-de6a-4602-9db8-4945e4fb0a81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:37.998076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7287ab6-de6a-4602-9db8-4945e4fb0a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:37.999490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7287ab6-de6a-4602-9db8-4945e4fb0a81 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:38.001053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 562/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:38.006850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cefdf1-0bed-431b-937f-9612869cc890 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:38.102126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cefdf1-0bed-431b-937f-9612869cc890 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:38.135753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3bab4-ec35-4e61-aa72-512d63bd1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:38.136352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3bab4-ec35-4e61-aa72-512d63bd1c41 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:38.136632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3bab4-ec35-4e61-aa72-512d63bd1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:38.136908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3bab4-ec35-4e61-aa72-512d63bd1c41 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:38.137587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3bab4-ec35-4e61-aa72-512d63bd1c41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:38.139048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3bab4-ec35-4e61-aa72-512d63bd1c41 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:38.225941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 548/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:04:38 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:40.257628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750313c-0be6-4572-a55b-6a4b27433056 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:40.258169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750313c-0be6-4572-a55b-6a4b27433056 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:40.258261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750313c-0be6-4572-a55b-6a4b27433056 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:40.259566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 563/1111] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:40.264700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b76df-7a56-4d23-9a84-f3ac896a0c33 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:40.265112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b76df-7a56-4d23-9a84-f3ac896a0c33 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:40.265257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b76df-7a56-4d23-9a84-f3ac896a0c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:40.283349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-730b76df-7a56-4d23-9a84-f3ac896a0c33 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:40.284544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-730b76df-7a56-4d23-9a84-f3ac896a0c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:40.293807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:40.351222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 549/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:40.374679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750313c-0be6-4572-a55b-6a4b27433056 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:40.475420 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750313c-0be6-4572-a55b-6a4b27433056 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:40.508575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:40.509130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:40.509411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:40.509687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] PATH_INFO: `/v3/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:40.511135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] RBAC: Authorizing `identity:get_role(role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:40.512489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:40.513843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 564/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:40 2022] GET /identity/v3/roles/db362c02a23549c9815e38259950ff5c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:40.519704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b76df-7a56-4d23-9a84-f3ac896a0c33 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:40.616214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b76df-7a56-4d23-9a84-f3ac896a0c33 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:40.648877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:40.649519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:40.649830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:40.650112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] PATH_INFO: `/v3/users/65ac6f2ed25e49d2a9047203de681830` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:40.663711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] RBAC: Authorizing `identity:get_user(user_id=65ac6f2ed25e49d2a9047203de681830)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:40.665156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:40.666819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 550/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:40 2022] GET /identity/v3/users/65ac6f2ed25e49d2a9047203de681830 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:40.672624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:40.691851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:40.773389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf816-0d3c-431c-b863-20be76ac897f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:40.806468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:40.807063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:40.807342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:40.807614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:40.875632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:40.877175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:40.895536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:40.976440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 565/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:40.982501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:40.985441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:41.088071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f69ad4-c975-4901-bfeb-71df5ac91a18 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:41.121377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10a27e-5472-4cd0-a292-705041c3ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:41.122030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10a27e-5472-4cd0-a292-705041c3ea4c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:41.122313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10a27e-5472-4cd0-a292-705041c3ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:41.122586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10a27e-5472-4cd0-a292-705041c3ea4c None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:41.123713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10a27e-5472-4cd0-a292-705041c3ea4c None admin] RBAC: Authorizing `identity:get_project(project_id=c124224d675f45c7868d40b8ed4ce72c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:41.125142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10a27e-5472-4cd0-a292-705041c3ea4c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:41.126828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 551/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:40 2022] GET /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:41.133757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:41.231606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832dd21-6e7d-4f34-ba90-07ee4916d9f2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:41.248729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:41.265091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee6355-ea5a-48d5-ba69-48a7c096afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:41.265695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee6355-ea5a-48d5-ba69-48a7c096afd7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:41.266007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee6355-ea5a-48d5-ba69-48a7c096afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:41.266285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee6355-ea5a-48d5-ba69-48a7c096afd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:41.267067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee6355-ea5a-48d5-ba69-48a7c096afd7 None admin] RBAC: Adding query filter params (role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=c124224d675f45c7868d40b8ed4ce72c, user.id=65ac6f2ed25e49d2a9047203de681830) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:41.267379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee6355-ea5a-48d5-ba69-48a7c096afd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:41.268801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee6355-ea5a-48d5-ba69-48a7c096afd7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:41.274103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 566/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:41 2022] GET /identity/v3/role_assignments?user.id=65ac6f2ed25e49d2a9047203de681830&scope.project.id=c124224d675f45c7868d40b8ed4ce72c&role.id=db362c02a23549c9815e38259950ff5c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:43.238024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef4e1a-3ddf-4cc3-a0f9-1e43703d97b7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.238615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef4e1a-3ddf-4cc3-a0f9-1e43703d97b7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.238615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef4e1a-3ddf-4cc3-a0f9-1e43703d97b7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.240424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 552/1118] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:43.246012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7d22c-e26f-4c4b-8fea-8e42c82f4740 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.246437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7d22c-e26f-4c4b-8fea-8e42c82f4740 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.246572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7d22c-e26f-4c4b-8fea-8e42c82f4740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.264884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c9e7d22c-e26f-4c4b-8fea-8e42c82f4740 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:43.266099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c9e7d22c-e26f-4c4b-8fea-8e42c82f4740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:43.332124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 567/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:43.354334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef4e1a-3ddf-4cc3-a0f9-1e43703d97b7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:43.423168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:43.453279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef4e1a-3ddf-4cc3-a0f9-1e43703d97b7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:43.486682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:43.487300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.487582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.487858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] PATH_INFO: `/v3/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.489330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] RBAC: Authorizing `identity:get_role(role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:43.490799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:43.492117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 553/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:43 2022] GET /identity/v3/roles/db362c02a23549c9815e38259950ff5c => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:43.497904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7d22c-e26f-4c4b-8fea-8e42c82f4740 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:43.593624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7d22c-e26f-4c4b-8fea-8e42c82f4740 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:43.607952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:43.629191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:43.629849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.630268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.630555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] PATH_INFO: `/v3/users/65ac6f2ed25e49d2a9047203de681830` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.631727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] RBAC: Authorizing `identity:get_user(user_id=65ac6f2ed25e49d2a9047203de681830)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:43.633152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:43.634769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 568/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:43 2022] GET /identity/v3/users/65ac6f2ed25e49d2a9047203de681830 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:43.640408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:43.746036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204b60f-7caa-4139-af52-fdfc769b1957 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:43.779339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb83b25-6247-4a94-bf20-dbd8524141f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:43.779970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb83b25-6247-4a94-bf20-dbd8524141f8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.780252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb83b25-6247-4a94-bf20-dbd8524141f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.780530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb83b25-6247-4a94-bf20-dbd8524141f8 None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.781674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb83b25-6247-4a94-bf20-dbd8524141f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c124224d675f45c7868d40b8ed4ce72c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:43.783134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb83b25-6247-4a94-bf20-dbd8524141f8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:43.784780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 554/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:43 2022] GET /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:43.790887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:43.888759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d6abd-ad8a-44c9-a447-0e7cb532cb0e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:43.921272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb6215-53e3-461a-b8a7-f4cc2ce7d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:43.921943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb6215-53e3-461a-b8a7-f4cc2ce7d723 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:43.922225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb6215-53e3-461a-b8a7-f4cc2ce7d723 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:43.922495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb6215-53e3-461a-b8a7-f4cc2ce7d723 None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c/users/65ac6f2ed25e49d2a9047203de681830/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:43.924613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb6215-53e3-461a-b8a7-f4cc2ce7d723 None admin] RBAC: Authorizing `identity:create_grant(project_id=c124224d675f45c7868d40b8ed4ce72c, user_id=65ac6f2ed25e49d2a9047203de681830, role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:43.926041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb6215-53e3-461a-b8a7-f4cc2ce7d723 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:43.999037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 569/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:04:43 2022] PUT /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c/users/65ac6f2ed25e49d2a9047203de681830/roles/db362c02a23549c9815e38259950ff5c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:04:45.992987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e6659-557e-46e3-876b-9412acba6ed6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:45.993543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e6659-557e-46e3-876b-9412acba6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:45.993543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e6659-557e-46e3-876b-9412acba6ed6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:45.994981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 555/1124] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:46.000031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9af81-a2a1-490b-9654-fd42823bc4f9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:46.000399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9af81-a2a1-490b-9654-fd42823bc4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:46.000588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9af81-a2a1-490b-9654-fd42823bc4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:46.019120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-48a9af81-a2a1-490b-9654-fd42823bc4f9 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:46.020295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-48a9af81-a2a1-490b-9654-fd42823bc4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:46.054798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:46.086617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 570/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:46.110036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e6659-557e-46e3-876b-9412acba6ed6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:46.120106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:46.211345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e6659-557e-46e3-876b-9412acba6ed6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:46.244656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:46.245277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:46.245552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:46.245854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] PATH_INFO: `/v3/roles/db362c02a23549c9815e38259950ff5c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:46.247260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] RBAC: Authorizing `identity:get_role(role_id=db362c02a23549c9815e38259950ff5c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:46.248626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:46.249977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 556/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:46 2022] GET /identity/v3/roles/db362c02a23549c9815e38259950ff5c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:46.256336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9af81-a2a1-490b-9654-fd42823bc4f9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:46.351406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9af81-a2a1-490b-9654-fd42823bc4f9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:46.384761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:46.385312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:46.385592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:46.385897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] PATH_INFO: `/v3/users/65ac6f2ed25e49d2a9047203de681830` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:46.387046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] RBAC: Authorizing `identity:get_user(user_id=65ac6f2ed25e49d2a9047203de681830)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:46.388458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:46.390059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 571/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:46 2022] GET /identity/v3/users/65ac6f2ed25e49d2a9047203de681830 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:46.396231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:46.468874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:46.494261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c702b-1ae8-4ed1-8714-98d6975980b7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:46.527130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:46.527725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:46.528003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:46.528274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:46.593500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:46.594968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:46.666767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:46.691268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 557/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:46.697516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:46.736612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:46.794551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766985-da03-4d7d-aa34-d77381c3a663 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:46.826660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824b6db-8c17-4266-8903-7f8b72bdaba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:46.827278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b6db-8c17-4266-8903-7f8b72bdaba8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:46.827560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b6db-8c17-4266-8903-7f8b72bdaba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:46.827837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b6db-8c17-4266-8903-7f8b72bdaba8 None admin] PATH_INFO: `/v3/projects/c124224d675f45c7868d40b8ed4ce72c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:46.828976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824b6db-8c17-4266-8903-7f8b72bdaba8 None admin] RBAC: Authorizing `identity:get_project(project_id=c124224d675f45c7868d40b8ed4ce72c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:46.830426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824b6db-8c17-4266-8903-7f8b72bdaba8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:46.832064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 572/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:46 2022] GET /identity/v3/projects/c124224d675f45c7868d40b8ed4ce72c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:46.838737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:46.936800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688904a-9d26-405f-9e06-b90f2f3c4fac None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:46.969785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe169-5b21-480e-b0f1-08dcc47764a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:46.970387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe169-5b21-480e-b0f1-08dcc47764a5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:46.970668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe169-5b21-480e-b0f1-08dcc47764a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:46.970942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe169-5b21-480e-b0f1-08dcc47764a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:46.971721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defe169-5b21-480e-b0f1-08dcc47764a5 None admin] RBAC: Adding query filter params (role.id=db362c02a23549c9815e38259950ff5c, scope.project.id=c124224d675f45c7868d40b8ed4ce72c, user.id=65ac6f2ed25e49d2a9047203de681830) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:46.972030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defe169-5b21-480e-b0f1-08dcc47764a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:46.973489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defe169-5b21-480e-b0f1-08dcc47764a5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:46.979626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 558/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:46 2022] GET /identity/v3/role_assignments?user.id=65ac6f2ed25e49d2a9047203de681830&scope.project.id=c124224d675f45c7868d40b8ed4ce72c&role.id=db362c02a23549c9815e38259950ff5c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:48.978101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d286d-8c7e-4c49-b5dc-de3aac880f5b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:48.978613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d286d-8c7e-4c49-b5dc-de3aac880f5b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:48.978727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d286d-8c7e-4c49-b5dc-de3aac880f5b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:48.980007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 573/1131] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:48.985453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a06ec-76ad-4be0-9b08-f5f342a73c29 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:48.985868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a06ec-76ad-4be0-9b08-f5f342a73c29 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:48.986068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a06ec-76ad-4be0-9b08-f5f342a73c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:49.004036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0d5a06ec-76ad-4be0-9b08-f5f342a73c29 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:49.005235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d5a06ec-76ad-4be0-9b08-f5f342a73c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:49.034956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:49.073271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 559/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:49.096400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d286d-8c7e-4c49-b5dc-de3aac880f5b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:49.195656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d286d-8c7e-4c49-b5dc-de3aac880f5b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:49.202679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:49.228627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3c03-fb60-48dc-bb05-bdf52dacaed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:49.229243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3c03-fb60-48dc-bb05-bdf52dacaed9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:49.229528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3c03-fb60-48dc-bb05-bdf52dacaed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:49.229833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3c03-fb60-48dc-bb05-bdf52dacaed9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:49.231065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d3c03-fb60-48dc-bb05-bdf52dacaed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:49.232487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d3c03-fb60-48dc-bb05-bdf52dacaed9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:49.234112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 574/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:49.240503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a06ec-76ad-4be0-9b08-f5f342a73c29 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:49.337570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a06ec-76ad-4be0-9b08-f5f342a73c29 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:49.372030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e45c6f-4a5f-4337-9df8-aee81b2b30a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:49.372634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45c6f-4a5f-4337-9df8-aee81b2b30a2 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:49.372910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45c6f-4a5f-4337-9df8-aee81b2b30a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:49.373180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45c6f-4a5f-4337-9df8-aee81b2b30a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:49.373889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e45c6f-4a5f-4337-9df8-aee81b2b30a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:49.375309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e45c6f-4a5f-4337-9df8-aee81b2b30a2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:49.488136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 560/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:04:49 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:04:51.670602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b7c93-3f31-49fc-ac8d-2339bff0fcea None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:51.671158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b7c93-3f31-49fc-ac8d-2339bff0fcea None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:51.671158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b7c93-3f31-49fc-ac8d-2339bff0fcea None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:51.672968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 575/1135] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:51.679043 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db9fd-3293-445c-b529-bcaa3d60e126 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:51.679647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db9fd-3293-445c-b529-bcaa3d60e126 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:51.679647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db9fd-3293-445c-b529-bcaa3d60e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:51.697612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5f4db9fd-3293-445c-b529-bcaa3d60e126 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:51.698828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5f4db9fd-3293-445c-b529-bcaa3d60e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:51.712216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:51.763738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 561/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:51.788859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b7c93-3f31-49fc-ac8d-2339bff0fcea None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:51.889331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b7c93-3f31-49fc-ac8d-2339bff0fcea None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:51.923526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26578105-2b0a-4201-a30b-958737d58799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:51.924144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26578105-2b0a-4201-a30b-958737d58799 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:51.924428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26578105-2b0a-4201-a30b-958737d58799 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:51.924707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26578105-2b0a-4201-a30b-958737d58799 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:51.925889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26578105-2b0a-4201-a30b-958737d58799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:51.927365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26578105-2b0a-4201-a30b-958737d58799 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:51.928946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 576/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:04:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:51.934904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db9fd-3293-445c-b529-bcaa3d60e126 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:52.037627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db9fd-3293-445c-b529-bcaa3d60e126 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:52.077609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83854690-1d39-46d5-bec0-ddf7eec84337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:52.078243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854690-1d39-46d5-bec0-ddf7eec84337 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:52.078521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854690-1d39-46d5-bec0-ddf7eec84337 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:52.078792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854690-1d39-46d5-bec0-ddf7eec84337 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:52.079476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83854690-1d39-46d5-bec0-ddf7eec84337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:52.080909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83854690-1d39-46d5-bec0-ddf7eec84337 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:52.191389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 562/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:04:51 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:04:54.220858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4a84-522e-47a5-8f1d-d06cf5ab8fda None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:54.221399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4a84-522e-47a5-8f1d-d06cf5ab8fda None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:54.221399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4a84-522e-47a5-8f1d-d06cf5ab8fda None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:54.222799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 577/1139] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:54.228977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a67879-9fa5-48fc-9f64-ce9ca10da867 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:54.229412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a67879-9fa5-48fc-9f64-ce9ca10da867 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:54.229550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a67879-9fa5-48fc-9f64-ce9ca10da867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:54.242951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:54.248232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-00a67879-9fa5-48fc-9f64-ce9ca10da867 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:54.249424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-00a67879-9fa5-48fc-9f64-ce9ca10da867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:54.314841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 563/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:54.338565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4a84-522e-47a5-8f1d-d06cf5ab8fda None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:54.385145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:54.443966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4a84-522e-47a5-8f1d-d06cf5ab8fda None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:54.479596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:54.480158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:54.480445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:54.480725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:54.491788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:54.496861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:54.497927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:54.498922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 578/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:54.504131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a67879-9fa5-48fc-9f64-ce9ca10da867 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:54.603648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a67879-9fa5-48fc-9f64-ce9ca10da867 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:54.637570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:54.638213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:54.638501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:54.638781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:54.639496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:54.639803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:54.641205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:54.643353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:54.649698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 564/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:04:54.655671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:54.754044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b49ed-2d44-4b08-89ea-f57213e01e61 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:54.755490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:54.787877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:54.788506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:54.788785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:54.789059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] PATH_INFO: `/v3/users/e94bdc0ea3cc4a10871dc8887c581856` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:54.801884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] RBAC: Authorizing `identity:get_user(user_id=e94bdc0ea3cc4a10871dc8887c581856)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:54.804119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:54.805976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 579/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:54 2022] GET /identity/v3/users/e94bdc0ea3cc4a10871dc8887c581856 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:54.811790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:54.910303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2399a8-d2cf-45f7-915f-ed8ac35e7f5f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:54.944125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:54.944732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:54.945009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:54.945283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:55.007990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:55.011338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:55.012910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:55.109371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 565/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:04:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:55.115932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:55.212905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e495-cb2b-43a1-bb27-6924b04ca27b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:55.245905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe7a8-7d64-492f-8c2d-b7ff661a9acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:55.246527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe7a8-7d64-492f-8c2d-b7ff661a9acf None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:55.246809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe7a8-7d64-492f-8c2d-b7ff661a9acf None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:55.247083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe7a8-7d64-492f-8c2d-b7ff661a9acf None admin] PATH_INFO: `/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:55.248218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe7a8-7d64-492f-8c2d-b7ff661a9acf None admin] RBAC: Authorizing `identity:get_project(project_id=ba172f9c00d4410cb67961dba8fa6ea2)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:55.249631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe7a8-7d64-492f-8c2d-b7ff661a9acf None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:55.251284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 580/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:55 2022] GET /identity/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:55.258262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:55.351029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:55.354484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73b542-8717-46df-9a94-46ff482db231 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:55.387131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588e6c-cd8f-408a-a4d4-56f6377df2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:55.387759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588e6c-cd8f-408a-a4d4-56f6377df2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:55.388040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588e6c-cd8f-408a-a4d4-56f6377df2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:55.388315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588e6c-cd8f-408a-a4d4-56f6377df2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:55.389094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588e6c-cd8f-408a-a4d4-56f6377df2f0 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=ba172f9c00d4410cb67961dba8fa6ea2, user.id=e94bdc0ea3cc4a10871dc8887c581856) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:55.389401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588e6c-cd8f-408a-a4d4-56f6377df2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:55.390865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588e6c-cd8f-408a-a4d4-56f6377df2f0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:55.396599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 566/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:04:55 2022] GET /identity/v3/role_assignments?user.id=e94bdc0ea3cc4a10871dc8887c581856&scope.project.id=ba172f9c00d4410cb67961dba8fa6ea2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:57.400472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93f4f8-320a-4cf1-ba72-9d71af5af65d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:57.401000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93f4f8-320a-4cf1-ba72-9d71af5af65d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:57.401000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93f4f8-320a-4cf1-ba72-9d71af5af65d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:57.402451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 581/1147] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:04:57.407569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaadd-f7f5-4b41-a60f-4610647afd06 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:57.407996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaadd-f7f5-4b41-a60f-4610647afd06 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:57.408133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaadd-f7f5-4b41-a60f-4610647afd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:57.426521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2d3aaadd-f7f5-4b41-a60f-4610647afd06 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:04:57.427750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2d3aaadd-f7f5-4b41-a60f-4610647afd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:04:57.493132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 567/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:04:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:04:57.515741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93f4f8-320a-4cf1-ba72-9d71af5af65d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:57.543299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:57.616523 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93f4f8-320a-4cf1-ba72-9d71af5af65d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:57.649579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:57.650225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:57.650562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:57.650787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:57.660597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:04:57.666137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:04:57.667303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:04:57.668362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 582/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:04:57.673279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aaadd-f7f5-4b41-a60f-4610647afd06 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:57.761734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:57.770066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aaadd-f7f5-4b41-a60f-4610647afd06 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:57.804222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:57.804836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:57.805120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:57.805400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:57.806143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:04:57.806453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:57.807825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:57.815628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 568/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:57.821566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:57.908662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:57.920948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c333-8b68-455a-b3a4-1782bda5984d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:57.954096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:57.954743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:57.955023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:57.955296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] PATH_INFO: `/v3/users/e94bdc0ea3cc4a10871dc8887c581856` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:57.956434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] RBAC: Authorizing `identity:get_user(user_id=e94bdc0ea3cc4a10871dc8887c581856)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:57.957877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:57.959662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 583/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:04:57 2022] GET /identity/v3/users/e94bdc0ea3cc4a10871dc8887c581856 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:57.965446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:58.063997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb2973-d183-44da-93f1-0db1a4351a1c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:58.096386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0f259-a5e0-44f2-804c-60220fbff213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:58.097011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0f259-a5e0-44f2-804c-60220fbff213 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:58.097297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0f259-a5e0-44f2-804c-60220fbff213 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:58.097574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0f259-a5e0-44f2-804c-60220fbff213 None admin] PATH_INFO: `/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:58.098887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0f259-a5e0-44f2-804c-60220fbff213 None admin] RBAC: Authorizing `identity:get_project(project_id=ba172f9c00d4410cb67961dba8fa6ea2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:58.100597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0f259-a5e0-44f2-804c-60220fbff213 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:58.102276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 569/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:04:57 2022] GET /identity/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:04:58.108174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:04:58.205465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef86d-a1ae-49c5-8cc9-8bbbb06938cb None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:04:58.238204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefd7ed-f4ce-4bb7-8841-63e26200f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:04:58.238851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefd7ed-f4ce-4bb7-8841-63e26200f374 None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:04:58.239136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefd7ed-f4ce-4bb7-8841-63e26200f374 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:04:58.239972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefd7ed-f4ce-4bb7-8841-63e26200f374 None admin] PATH_INFO: `/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2/users/e94bdc0ea3cc4a10871dc8887c581856/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:04:58.242074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefd7ed-f4ce-4bb7-8841-63e26200f374 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba172f9c00d4410cb67961dba8fa6ea2, user_id=e94bdc0ea3cc4a10871dc8887c581856, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:04:58.243495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefd7ed-f4ce-4bb7-8841-63e26200f374 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:04:58.305190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 584/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:04:58 2022] PUT /identity/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2/users/e94bdc0ea3cc4a10871dc8887c581856/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:00.319402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758712b6-43da-41ab-81ff-1cd3393041d5 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:00.319947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758712b6-43da-41ab-81ff-1cd3393041d5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:00.319947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758712b6-43da-41ab-81ff-1cd3393041d5 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:00.321311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 570/1154] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:00.326648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e937ea-612e-43c3-8b45-fc3eb1acc0c6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:00.327022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e937ea-612e-43c3-8b45-fc3eb1acc0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:00.327223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e937ea-612e-43c3-8b45-fc3eb1acc0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:00.345544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d4e937ea-612e-43c3-8b45-fc3eb1acc0c6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:00.346757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d4e937ea-612e-43c3-8b45-fc3eb1acc0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:00.358037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:00.412636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 585/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:05:00.435652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758712b6-43da-41ab-81ff-1cd3393041d5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:00.462793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:00.545827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758712b6-43da-41ab-81ff-1cd3393041d5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:00.578951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:00.579515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:00.579796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:00.580072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:00.591115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:05:00.596042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:05:00.597169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:05:00.598291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 571/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:05:00.603895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e937ea-612e-43c3-8b45-fc3eb1acc0c6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:00.700395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e937ea-612e-43c3-8b45-fc3eb1acc0c6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:00.734439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:00.735045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:00.735328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:00.735606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:00.736316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:00.736621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:00.738003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:00.745824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 586/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:00.751528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:00.832880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:00.851725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042558e-2f02-4de8-b1a3-ab0998fd6081 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:00.886508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:00.887239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:00.893034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:00.893034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] PATH_INFO: `/v3/users/e94bdc0ea3cc4a10871dc8887c581856` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:00.893034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] RBAC: Authorizing `identity:get_user(user_id=e94bdc0ea3cc4a10871dc8887c581856)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:00.893034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:00.893034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 572/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:05:00 2022] GET /identity/v3/users/e94bdc0ea3cc4a10871dc8887c581856 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:00.897793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:00.909145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:00.996206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18d94-7e18-4fe2-b1cc-05ba90c5916c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:01.029230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:01.029872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:01.030157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:01.030433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:01.096737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:01.098148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:01.107678 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:01.196530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 587/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:05:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:05:01.202401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:01.298890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7d3a6-1db8-4e45-abec-99a1457f6684 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:01.331165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82292d-3496-425a-ad3d-52bb6ab8d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:01.331790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82292d-3496-425a-ad3d-52bb6ab8d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:01.332072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82292d-3496-425a-ad3d-52bb6ab8d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:01.332348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82292d-3496-425a-ad3d-52bb6ab8d5c6 None admin] PATH_INFO: `/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:01.334054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82292d-3496-425a-ad3d-52bb6ab8d5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=ba172f9c00d4410cb67961dba8fa6ea2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:01.335480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82292d-3496-425a-ad3d-52bb6ab8d5c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:01.337112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 573/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:05:01 2022] GET /identity/v3/projects/ba172f9c00d4410cb67961dba8fa6ea2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:01.343306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:01.440468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789553d9-5b98-4ae7-99f4-78ecc11083fd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:01.450212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:01.474225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4718b-330d-4cee-a376-2402201ab6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:01.475025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4718b-330d-4cee-a376-2402201ab6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:01.475310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4718b-330d-4cee-a376-2402201ab6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:01.475587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4718b-330d-4cee-a376-2402201ab6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:01.476369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4718b-330d-4cee-a376-2402201ab6f9 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=ba172f9c00d4410cb67961dba8fa6ea2, user.id=e94bdc0ea3cc4a10871dc8887c581856) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:01.476681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4718b-330d-4cee-a376-2402201ab6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:01.478132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4718b-330d-4cee-a376-2402201ab6f9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:01.484451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 588/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:05:01 2022] GET /identity/v3/role_assignments?user.id=e94bdc0ea3cc4a10871dc8887c581856&scope.project.id=ba172f9c00d4410cb67961dba8fa6ea2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:03.482633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544b95-a387-473a-9fab-e5760ac1a912 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:03.483205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544b95-a387-473a-9fab-e5760ac1a912 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:03.483205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544b95-a387-473a-9fab-e5760ac1a912 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:03.484516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 574/1162] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:03.489641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3209-8f19-44fc-a570-e63ed4f6ab05 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:03.490100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3209-8f19-44fc-a570-e63ed4f6ab05 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:03.490232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3209-8f19-44fc-a570-e63ed4f6ab05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:03.507836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c20c3209-8f19-44fc-a570-e63ed4f6ab05 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:03.509012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c20c3209-8f19-44fc-a570-e63ed4f6ab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:03.575776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 589/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:05:03.597827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544b95-a387-473a-9fab-e5760ac1a912 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:03.617608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:03.698494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544b95-a387-473a-9fab-e5760ac1a912 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:03.731502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:03.732111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:03.732390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:03.732718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:03.797990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:03.799486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:03.816699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:03.899830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 575/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:05:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:05:03.905895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3209-8f19-44fc-a570-e63ed4f6ab05 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:04.000544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3209-8f19-44fc-a570-e63ed4f6ab05 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:04.001963 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:04.033509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb9674-2eaa-4e6f-a9ee-f1d1b9ac32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:04.034166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb9674-2eaa-4e6f-a9ee-f1d1b9ac32b0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:04.034449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb9674-2eaa-4e6f-a9ee-f1d1b9ac32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:04.034724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb9674-2eaa-4e6f-a9ee-f1d1b9ac32b0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:04.041355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb9674-2eaa-4e6f-a9ee-f1d1b9ac32b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:04.042804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb9674-2eaa-4e6f-a9ee-f1d1b9ac32b0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-91fb9674-2eaa-4e6f-a9ee-f1d1b9ac32b0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:05:04.054588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:05:04.055820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:05:04.057007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 590/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:05:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:05:04.061655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:04.159154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1825a5-f88f-4f6e-940a-acf318f75ed0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:04.176397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:04.193051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459b2fe-a3aa-4d38-a69f-bc2d0e477fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:04.193788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459b2fe-a3aa-4d38-a69f-bc2d0e477fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:04.194074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459b2fe-a3aa-4d38-a69f-bc2d0e477fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:04.194351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459b2fe-a3aa-4d38-a69f-bc2d0e477fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:04.195035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459b2fe-a3aa-4d38-a69f-bc2d0e477fa1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:04.195339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459b2fe-a3aa-4d38-a69f-bc2d0e477fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:04.196699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459b2fe-a3aa-4d38-a69f-bc2d0e477fa1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:04.203575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 576/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Tue Aug 2 09:05:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:06.222323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e690-3094-4b4f-a934-d71a4f75fd46 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.222838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e690-3094-4b4f-a934-d71a4f75fd46 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.222948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e690-3094-4b4f-a934-d71a4f75fd46 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.225513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 591/1167] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:06.230630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf48b-73ae-4a6f-bab2-358b166e5b87 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.231052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf48b-73ae-4a6f-bab2-358b166e5b87 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.231184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf48b-73ae-4a6f-bab2-358b166e5b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.249439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2aedf48b-73ae-4a6f-bab2-358b166e5b87 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:06.250656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2aedf48b-73ae-4a6f-bab2-358b166e5b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:06.315363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 577/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:05:06.338851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e690-3094-4b4f-a934-d71a4f75fd46 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:06.439702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e690-3094-4b4f-a934-d71a4f75fd46 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:06.472597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d005bb-80f4-4031-bb89-c90d8f6c331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:06.473137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d005bb-80f4-4031-bb89-c90d8f6c331e None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:06.473416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d005bb-80f4-4031-bb89-c90d8f6c331e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:06.474210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d005bb-80f4-4031-bb89-c90d8f6c331e None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:06.475165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d005bb-80f4-4031-bb89-c90d8f6c331e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:06.476553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d005bb-80f4-4031-bb89-c90d8f6c331e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:06.550455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 592/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Tue Aug 2 09:05:06 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:05:08.584418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e6123-8414-4887-888b-96eff407e7d1 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:08.584947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e6123-8414-4887-888b-96eff407e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:08.585066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e6123-8414-4887-888b-96eff407e7d1 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:08.586380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 578/1170] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:08.591516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540ab0-fa97-4ef2-b6c5-22fb5dbbcfe1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:08.591934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540ab0-fa97-4ef2-b6c5-22fb5dbbcfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:08.592071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540ab0-fa97-4ef2-b6c5-22fb5dbbcfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:08.610990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-85540ab0-fa97-4ef2-b6c5-22fb5dbbcfe1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:08.612153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-85540ab0-fa97-4ef2-b6c5-22fb5dbbcfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:08.628886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:08.680444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 593/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:05:08.703328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e6123-8414-4887-888b-96eff407e7d1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:08.802046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e6123-8414-4887-888b-96eff407e7d1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:08.814539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:08.835115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35939fef-f6a9-426c-80a2-281288ab4154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:08.835857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35939fef-f6a9-426c-80a2-281288ab4154 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:08.836313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35939fef-f6a9-426c-80a2-281288ab4154 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:08.836853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35939fef-f6a9-426c-80a2-281288ab4154 None admin] PATH_INFO: `/v3/domains/cc73deaa33674fe0a558544887a06d26` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:08.846962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35939fef-f6a9-426c-80a2-281288ab4154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc73deaa33674fe0a558544887a06d26)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:08.848431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35939fef-f6a9-426c-80a2-281288ab4154 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:08.851076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 579/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Tue Aug 2 09:05:08 2022] GET /identity/v3/domains/cc73deaa33674fe0a558544887a06d26 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:08.857188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540ab0-fa97-4ef2-b6c5-22fb5dbbcfe1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:08.956209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540ab0-fa97-4ef2-b6c5-22fb5dbbcfe1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:08.989313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566ae04-ec1a-40b3-a4b4-71e6c7fd6b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:08.990010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ae04-ec1a-40b3-a4b4-71e6c7fd6b17 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:08.990294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ae04-ec1a-40b3-a4b4-71e6c7fd6b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:08.990572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ae04-ec1a-40b3-a4b4-71e6c7fd6b17 None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:08.991290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566ae04-ec1a-40b3-a4b4-71e6c7fd6b17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:08.992768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566ae04-ec1a-40b3-a4b4-71e6c7fd6b17 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:09.081410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 594/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:05:08 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:05:11.113048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7645-640e-41ce-8ed0-c1e9389be95e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:11.113572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7645-640e-41ce-8ed0-c1e9389be95e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:11.113695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7645-640e-41ce-8ed0-c1e9389be95e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:11.115359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 580/1174] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:11.120497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e5ae-ae36-420a-8a1d-5dd72221c7d4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:11.120882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e5ae-ae36-420a-8a1d-5dd72221c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:11.120994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e5ae-ae36-420a-8a1d-5dd72221c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:11.128147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:11.138938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e6f4e5ae-ae36-420a-8a1d-5dd72221c7d4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:11.140123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e6f4e5ae-ae36-420a-8a1d-5dd72221c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:11.207214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 595/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:05:11.232557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7645-640e-41ce-8ed0-c1e9389be95e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:11.331815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7645-640e-41ce-8ed0-c1e9389be95e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:11.364786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32024103-b334-4a6d-8e4f-88213e6465ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:11.365397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32024103-b334-4a6d-8e4f-88213e6465ac None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:11.365679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32024103-b334-4a6d-8e4f-88213e6465ac None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:11.365987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32024103-b334-4a6d-8e4f-88213e6465ac None admin] PATH_INFO: `/v3/domains/cc73deaa33674fe0a558544887a06d26` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:11.367128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32024103-b334-4a6d-8e4f-88213e6465ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc73deaa33674fe0a558544887a06d26)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:11.368559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32024103-b334-4a6d-8e4f-88213e6465ac None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:11.370164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 581/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Tue Aug 2 09:05:11 2022] GET /identity/v3/domains/cc73deaa33674fe0a558544887a06d26 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:11.376111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e5ae-ae36-420a-8a1d-5dd72221c7d4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:11.474206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e5ae-ae36-420a-8a1d-5dd72221c7d4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:11.507377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fdeea-c3a9-466b-ae31-1cdfa59a71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:11.508081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdeea-c3a9-466b-ae31-1cdfa59a71b7 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:11.508364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdeea-c3a9-466b-ae31-1cdfa59a71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:11.508640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdeea-c3a9-466b-ae31-1cdfa59a71b7 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:11.509326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fdeea-c3a9-466b-ae31-1cdfa59a71b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:11.510779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fdeea-c3a9-466b-ae31-1cdfa59a71b7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:11.518896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:11.561208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 596/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:05:11 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:05:13.616722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8bc86-6835-4261-a7f8-bd08875c7fec None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:13.617303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8bc86-6835-4261-a7f8-bd08875c7fec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:13.617303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8bc86-6835-4261-a7f8-bd08875c7fec None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:13.618658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 582/1178] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:13.624008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7ed5c-31eb-42bc-978b-c571aa1238ad None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:13.624437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7ed5c-31eb-42bc-978b-c571aa1238ad None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:13.624543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7ed5c-31eb-42bc-978b-c571aa1238ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:13.643033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8bd7ed5c-31eb-42bc-978b-c571aa1238ad None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:13.644201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8bd7ed5c-31eb-42bc-978b-c571aa1238ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:13.709840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 597/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:05:13.732882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8bc86-6835-4261-a7f8-bd08875c7fec None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:13.775256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:13.831949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8bc86-6835-4261-a7f8-bd08875c7fec None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:13.866871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:13.866871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:13.866871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:13.866871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:13.876816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:05:13.882395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:05:13.883585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:05:13.884699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 583/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:05:13.889700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7ed5c-31eb-42bc-978b-c571aa1238ad None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:13.985404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7ed5c-31eb-42bc-978b-c571aa1238ad None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:14.007101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:14.020220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:14.021545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:14.021545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:14.021764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:14.022316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:14.022620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:14.023968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:14.031714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 598/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:05:14.037837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:14.133874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:14.136731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dde52b-aee7-4a4e-9f5a-8598b8d6146b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:14.170185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:14.170810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:14.171096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:14.171379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] PATH_INFO: `/v3/users/f5d1d8cae79d4b39bed5922440eaf773` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:14.185766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d1d8cae79d4b39bed5922440eaf773)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:14.187226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:14.188947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 584/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:05:14 2022] GET /identity/v3/users/f5d1d8cae79d4b39bed5922440eaf773 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:14.194984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:14.291919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87190a-3ebc-4182-b835-6954e9717f3d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:14.325116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:14.325749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:14.326039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:14.326316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:14.374638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:14.392169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:14.393549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:14.488133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 599/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:05:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:05:14.494160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:14.589853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c619da-83bd-411e-8d84-3d7dc1058842 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:14.622869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f360c-31b8-4a0b-a945-000a2282d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:14.623492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f360c-31b8-4a0b-a945-000a2282d73c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:14.623774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f360c-31b8-4a0b-a945-000a2282d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:14.624051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f360c-31b8-4a0b-a945-000a2282d73c None admin] PATH_INFO: `/v3/projects/dba0036300594a509785c2e8ef242d1e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:14.625188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f360c-31b8-4a0b-a945-000a2282d73c None admin] RBAC: Authorizing `identity:get_project(project_id=dba0036300594a509785c2e8ef242d1e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:14.626670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f360c-31b8-4a0b-a945-000a2282d73c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:14.628295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 585/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:05:14 2022] GET /identity/v3/projects/dba0036300594a509785c2e8ef242d1e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:14.635260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:14.714322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:14.731899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d777d-8aa3-48c2-a06a-39ad845eee6d None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:14.766095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384af4e-8393-4bcd-be9a-c604904d3d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:14.766702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384af4e-8393-4bcd-be9a-c604904d3d16 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:14.766984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384af4e-8393-4bcd-be9a-c604904d3d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:14.767261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384af4e-8393-4bcd-be9a-c604904d3d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:14.768040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384af4e-8393-4bcd-be9a-c604904d3d16 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=dba0036300594a509785c2e8ef242d1e, user.id=f5d1d8cae79d4b39bed5922440eaf773) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:14.768349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384af4e-8393-4bcd-be9a-c604904d3d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:14.769803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384af4e-8393-4bcd-be9a-c604904d3d16 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:14.775243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 600/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:05:14 2022] GET /identity/v3/role_assignments?user.id=f5d1d8cae79d4b39bed5922440eaf773&scope.project.id=dba0036300594a509785c2e8ef242d1e&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:16.730871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca2366-94c6-4f4e-9997-c72d28fc690b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:16.731432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca2366-94c6-4f4e-9997-c72d28fc690b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:16.731432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca2366-94c6-4f4e-9997-c72d28fc690b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:16.732744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 586/1186] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:16.737814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8003f2-eb03-482a-b31b-05d2f54589c5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:16.738197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8003f2-eb03-482a-b31b-05d2f54589c5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:16.738373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8003f2-eb03-482a-b31b-05d2f54589c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:16.756549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3b8003f2-eb03-482a-b31b-05d2f54589c5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:16.757753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3b8003f2-eb03-482a-b31b-05d2f54589c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:16.823436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 601/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:05:16.845152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca2366-94c6-4f4e-9997-c72d28fc690b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:16.873263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:16.946061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca2366-94c6-4f4e-9997-c72d28fc690b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:16.978517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:16.979142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:16.979423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:16.979697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:16.990500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:05:16.995336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:05:16.996418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:05:16.997318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 587/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:05:17.002588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8003f2-eb03-482a-b31b-05d2f54589c5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:17.078190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:17.100315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8003f2-eb03-482a-b31b-05d2f54589c5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:17.134379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:17.134985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:17.135264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:17.135532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:17.136227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:17.136524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:17.137900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:17.145961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 602/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:17.151813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:17.235068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:17.252760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c08be6-92b4-4e27-8ea5-9426cdd52396 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:17.282837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:17.283462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:17.283741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:17.284015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] PATH_INFO: `/v3/users/f5d1d8cae79d4b39bed5922440eaf773` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:17.285166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d1d8cae79d4b39bed5922440eaf773)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:17.287153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:17.288740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 588/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:05:17 2022] GET /identity/v3/users/f5d1d8cae79d4b39bed5922440eaf773 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:17.294548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:17.392679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f7d2-841c-4d00-80c6-9f49487d4477 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:17.425569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82111e-5107-47dc-a913-46a08302ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:17.426221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82111e-5107-47dc-a913-46a08302ff07 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:17.426507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82111e-5107-47dc-a913-46a08302ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:17.426788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82111e-5107-47dc-a913-46a08302ff07 None admin] PATH_INFO: `/v3/projects/dba0036300594a509785c2e8ef242d1e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:17.428118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82111e-5107-47dc-a913-46a08302ff07 None admin] RBAC: Authorizing `identity:get_project(project_id=dba0036300594a509785c2e8ef242d1e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:17.429553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82111e-5107-47dc-a913-46a08302ff07 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:17.431233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 603/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:05:17 2022] GET /identity/v3/projects/dba0036300594a509785c2e8ef242d1e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:17.437287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:17.535420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee46e-a77b-4d0a-856f-d4b713609279 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:17.568638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0643fad-d31d-498b-9982-da1671f3123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:17.569282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643fad-d31d-498b-9982-da1671f3123d None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:17.569560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643fad-d31d-498b-9982-da1671f3123d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:17.569866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643fad-d31d-498b-9982-da1671f3123d None admin] PATH_INFO: `/v3/projects/dba0036300594a509785c2e8ef242d1e/users/f5d1d8cae79d4b39bed5922440eaf773/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:17.571764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0643fad-d31d-498b-9982-da1671f3123d None admin] RBAC: Authorizing `identity:create_grant(project_id=dba0036300594a509785c2e8ef242d1e, user_id=f5d1d8cae79d4b39bed5922440eaf773, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:17.573188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0643fad-d31d-498b-9982-da1671f3123d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:17.647351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 589/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:05:17 2022] PUT /identity/v3/projects/dba0036300594a509785c2e8ef242d1e/users/f5d1d8cae79d4b39bed5922440eaf773/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:05:19.626578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75a4ea-2a89-4b3a-a6b7-dadd010cbf3a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:19.627129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75a4ea-2a89-4b3a-a6b7-dadd010cbf3a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:19.627129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75a4ea-2a89-4b3a-a6b7-dadd010cbf3a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:19.628493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 604/1193] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:05:19.633835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521208e0-44a9-4f45-a9f6-acc15e5334d6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:19.634265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521208e0-44a9-4f45-a9f6-acc15e5334d6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:19.634395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521208e0-44a9-4f45-a9f6-acc15e5334d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:19.651966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-521208e0-44a9-4f45-a9f6-acc15e5334d6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:05:19.653132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-521208e0-44a9-4f45-a9f6-acc15e5334d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:05:19.662561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:19.717273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 590/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:05:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:05:19.741956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75a4ea-2a89-4b3a-a6b7-dadd010cbf3a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:19.751166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:19.848002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75a4ea-2a89-4b3a-a6b7-dadd010cbf3a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:19.886478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:19.887046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:19.887330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:19.887608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:19.898561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:05:19.903408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:05:19.904530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:05:19.905771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 605/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:05:19.911598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521208e0-44a9-4f45-a9f6-acc15e5334d6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:20.010256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521208e0-44a9-4f45-a9f6-acc15e5334d6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:20.042373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:20.042976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:20.043259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:20.043538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:20.044250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:20.044554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:20.045962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:20.054891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 591/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:20.060647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:20.125201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:20.159613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceccf0b-859d-4fa3-a0c2-5e61239c0d8e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:20.192979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:20.193638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:20.193950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:20.194231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] PATH_INFO: `/v3/users/f5d1d8cae79d4b39bed5922440eaf773` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:20.195388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d1d8cae79d4b39bed5922440eaf773)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:20.196821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:20.198432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 606/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Tue Aug 2 09:05:20 2022] GET /identity/v3/users/f5d1d8cae79d4b39bed5922440eaf773 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:20.204112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:20.213373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:20.304181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce23632-3914-48a7-bed3-82dfc4d12f0b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:20.336438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:20.337040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:20.337320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:20.337591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:20.403533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:20.405615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:20.415316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:20.503509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 592/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:05:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:05:20.509398 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:20.607753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7db9-7bad-4270-89e2-7f387f1b8da8 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:20.639862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be141c17-93c7-420d-9fd3-6dea082ca4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:20.640486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141c17-93c7-420d-9fd3-6dea082ca4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:20.640769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141c17-93c7-420d-9fd3-6dea082ca4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:20.641045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141c17-93c7-420d-9fd3-6dea082ca4f7 None admin] PATH_INFO: `/v3/projects/dba0036300594a509785c2e8ef242d1e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:20.642220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141c17-93c7-420d-9fd3-6dea082ca4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=dba0036300594a509785c2e8ef242d1e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:20.643639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141c17-93c7-420d-9fd3-6dea082ca4f7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:20.645279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 607/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Tue Aug 2 09:05:20 2022] GET /identity/v3/projects/dba0036300594a509785c2e8ef242d1e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:20.651912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:05:20.747477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6ee7-4716-4f0f-9224-2174ae57f998 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:05:20.754443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:20.780142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c2e64-b376-46fd-b9d3-543065c438ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:05:20.780742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2e64-b376-46fd-b9d3-543065c438ec None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:05:20.781024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2e64-b376-46fd-b9d3-543065c438ec None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:05:20.781300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2e64-b376-46fd-b9d3-543065c438ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:05:20.782117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c2e64-b376-46fd-b9d3-543065c438ec None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=dba0036300594a509785c2e8ef242d1e, user.id=f5d1d8cae79d4b39bed5922440eaf773) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:05:20.782427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c2e64-b376-46fd-b9d3-543065c438ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:05:20.783853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c2e64-b376-46fd-b9d3-543065c438ec None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:05:20.790541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 593/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:05:20 2022] GET /identity/v3/role_assignments?user.id=f5d1d8cae79d4b39bed5922440eaf773&scope.project.id=dba0036300594a509785c2e8ef242d1e&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:05:30.635708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:30.791900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=15 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:30.699132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd866c-a3f1-45b7-a477-8b6cd0460a22 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:30.699771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd866c-a3f1-45b7-a477-8b6cd0460a22 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:30.699771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd866c-a3f1-45b7-a477-8b6cd0460a22 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:30.701070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 608/1201] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:30.706159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4bc0a-84e1-4277-8f78-b0fa6e6c27f7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:30.706600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4bc0a-84e1-4277-8f78-b0fa6e6c27f7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:30.706701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4bc0a-84e1-4277-8f78-b0fa6e6c27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:30.726046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7da4bc0a-84e1-4277-8f78-b0fa6e6c27f7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:30.727251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7da4bc0a-84e1-4277-8f78-b0fa6e6c27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:30.794644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 594/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:30.819529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd866c-a3f1-45b7-a477-8b6cd0460a22 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:30.922958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd866c-a3f1-45b7-a477-8b6cd0460a22 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:30.961771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:30.962338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:30.962616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:30.962886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:30.972663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:30.974106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:30.989864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:30.991023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:30.992037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:30.992037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:30.992037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:30.992037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:30.992037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 609/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:30.997157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4bc0a-84e1-4277-8f78-b0fa6e6c27f7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:31.092476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4bc0a-84e1-4277-8f78-b0fa6e6c27f7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:31.122303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:31.127921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc12ab4-c7c1-4cd2-b4c1-b231f31922c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:31.128531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12ab4-c7c1-4cd2-b4c1-b231f31922c3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:31.128811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12ab4-c7c1-4cd2-b4c1-b231f31922c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:31.129087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12ab4-c7c1-4cd2-b4c1-b231f31922c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:31.129811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12ab4-c7c1-4cd2-b4c1-b231f31922c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:31.130116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12ab4-c7c1-4cd2-b4c1-b231f31922c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:31.131481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12ab4-c7c1-4cd2-b4c1-b231f31922c3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:31.142773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 595/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:31.149154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:31.203890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:31.252689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0631f-65f0-4a3e-9ced-41ceac48a7d9 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:31.287219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adf239-968d-4753-ac48-87b80f53ebca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:31.287825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf239-968d-4753-ac48-87b80f53ebca None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:31.288805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf239-968d-4753-ac48-87b80f53ebca None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:31.289148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf239-968d-4753-ac48-87b80f53ebca None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:31.289840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adf239-968d-4753-ac48-87b80f53ebca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:31.291280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adf239-968d-4753-ac48-87b80f53ebca None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:31.382829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 610/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Tue Aug 2 09:06:31 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:06:33.444380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1c4-136a-4cfb-ba2e-d5e193d83872 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:33.445273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1c4-136a-4cfb-ba2e-d5e193d83872 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:33.445273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1c4-136a-4cfb-ba2e-d5e193d83872 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:33.446327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 596/1206] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:33.451868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559372-a0e9-478e-aac0-9947c416e0a5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:33.452289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559372-a0e9-478e-aac0-9947c416e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:33.452426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559372-a0e9-478e-aac0-9947c416e0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:33.471411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-be559372-a0e9-478e-aac0-9947c416e0a5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:33.472612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-be559372-a0e9-478e-aac0-9947c416e0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:33.539517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 611/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:33.562989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a1c4-136a-4cfb-ba2e-d5e193d83872 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:33.666638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a1c4-136a-4cfb-ba2e-d5e193d83872 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:33.699693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:33.700356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:33.700693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:33.701036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:33.712510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:06:33.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:33.719886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:33.720796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 597/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:33.724673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be559372-a0e9-478e-aac0-9947c416e0a5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:33.764574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:33.825096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be559372-a0e9-478e-aac0-9947c416e0a5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:33.859237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:33.859853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:33.860139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:33.860421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:33.861175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:33.861484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:33.862885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:33.871171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 612/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:33.876928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:33.928484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:33.978642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82dbc9-1b62-4355-99c7-38b8fd1347a3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:34.012176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:34.012806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:34.013086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:34.013360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:34.024785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:34.026316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:34.040234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:34.041352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:34.042420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:34.042420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:34.042420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:34.042420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:34.042420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 598/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:34.047250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:34.144495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:34.147536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd2d39-9641-46f7-8662-f8d079004811 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:34.180781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:34.181380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:34.181656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:34.181954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:34.182635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:34.182937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:34.184281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:34.196131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 613/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:06:34.201785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:34.302362 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08126941-2f3b-4537-ac8e-dd4908a86b80 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:34.304240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:34.336812 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:34.337447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:34.337752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:34.338031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:34.345356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:34.346842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:06:34.358311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:34.364474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:34.365697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 599/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:34.368021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:34.469150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d66ed0-b5e1-4a33-b978-2eefcdd9178e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:34.502778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:34.503387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:34.503667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:34.503940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:34.504733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:34.505040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:34.506479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:34.524042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 614/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Tue Aug 2 09:06:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:34.529955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:34.628808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375c1f-478c-4d4e-b43c-d33d1fee5e87 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:34.662562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:34.663204 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:34.663571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:34.663853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:34.695249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:34.731316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:34.732779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:34.830981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 600/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:06:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:06:34.837483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:34.857188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:34.939578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a0c72-654a-4bb8-9728-8d0f256dc0d2 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:34.973502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:34.974162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:34.974445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:34.974717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:34.985235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:34.986717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:35.008573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:35.009552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:35.010506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:35.010506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:35.010506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:35.010506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:35.010506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 615/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:35.015481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:35.076723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:35.115371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1f8e7-bc09-40bb-be8b-954ab5fa9f9d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:35.149573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:35.150224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:35.150507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:35.150786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:35.151540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:35.151848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:35.153248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:35.165000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 601/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:35.170930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:35.242838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:35.273362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15490149-edd0-40f3-a10c-31af198ed493 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:35.306895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:35.307516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:35.307795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:35.308067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:35.314504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:35.315920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:06:35.327643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:35.328742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:35.329923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 616/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:35.334911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:35.434876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c149c-d43a-459d-8050-deac7f1374c3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:35.456992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:35.469049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1669196-3550-4386-920a-ca0337bfc753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:35.469656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669196-3550-4386-920a-ca0337bfc753 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:35.469963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669196-3550-4386-920a-ca0337bfc753 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:35.470237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669196-3550-4386-920a-ca0337bfc753 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:35.470976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669196-3550-4386-920a-ca0337bfc753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:35.471279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669196-3550-4386-920a-ca0337bfc753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:35.473051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669196-3550-4386-920a-ca0337bfc753 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:35.486082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 602/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:35.492789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:35.592600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcda73-ccc6-49af-bb4f-c36a680f66fe None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:35.620905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:35.626466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcff2aa-2227-419b-920b-725b4afc1bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:35.627105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff2aa-2227-419b-920b-725b4afc1bff None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:35.627388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff2aa-2227-419b-920b-725b4afc1bff None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:35.627663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff2aa-2227-419b-920b-725b4afc1bff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:35.628441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcff2aa-2227-419b-920b-725b4afc1bff None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=41aaa2d337974ae29ef28b1126e70435) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:35.628748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcff2aa-2227-419b-920b-725b4afc1bff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:35.630201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcff2aa-2227-419b-920b-725b4afc1bff None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:35.635841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 617/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:06:35 2022] GET /identity/v3/role_assignments?user.id=41aaa2d337974ae29ef28b1126e70435&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:37.611142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a219635-9433-4664-b0b8-9d5aa58a9b05 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:37.611710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a219635-9433-4664-b0b8-9d5aa58a9b05 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:37.611710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a219635-9433-4664-b0b8-9d5aa58a9b05 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:37.613058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 603/1220] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:37.618319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8ebc9-ccc2-4920-9af7-0f26f0ae2d15 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:37.618740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8ebc9-ccc2-4920-9af7-0f26f0ae2d15 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:37.618879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8ebc9-ccc2-4920-9af7-0f26f0ae2d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:37.637299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8dd8ebc9-ccc2-4920-9af7-0f26f0ae2d15 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:37.638528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8dd8ebc9-ccc2-4920-9af7-0f26f0ae2d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:37.704354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 618/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:37.727383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a219635-9433-4664-b0b8-9d5aa58a9b05 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:37.831625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a219635-9433-4664-b0b8-9d5aa58a9b05 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:37.865448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:37.866710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:37.866994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:37.867270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:37.877447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:06:37.882596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:37.886173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:37.887032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 604/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:37.890155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8ebc9-ccc2-4920-9af7-0f26f0ae2d15 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:37.989871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8ebc9-ccc2-4920-9af7-0f26f0ae2d15 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:38.012821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:38.023842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:38.024449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:38.024727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:38.025003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:38.025701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] RBAC: Adding query filter params (name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:38.026032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:38.027426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:38.035017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 619/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:38.041521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:38.085742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:38.143718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefdfe6-9b65-48fe-a178-d41bf0fc043f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:38.179036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:38.179660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:38.179947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:38.180224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:38.190040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:38.191501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:38.207100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:38.208187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:38.209099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:38.209099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:38.209099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:38.209099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:38.209099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 605/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:38.214897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:38.313356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b3535-9571-438e-8655-5af56e66fbae None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:38.347984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:38.348596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:38.348896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:38.349159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:38.349873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:38.350532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:38.351897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:38.364212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 620/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:38.370290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:38.464352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:38.470847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb298eb-95dc-42bb-b32f-15fdd4d9b55f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:38.503559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:38.504188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:38.504467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:38.504741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:38.512480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:38.514088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:06:38.526611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:38.529278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:38.530523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 606/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:38.534051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:38.579918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:38.633330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4c82-fb45-46e3-b21a-0ed538d7d253 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:38.668178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:38.668789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:38.669072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:38.669347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:38.670155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:38.670461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:38.671900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:38.689177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 621/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Tue Aug 2 09:06:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:38.695145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:38.802571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65eb80-2a79-4efa-bc94-5a8227f2b01d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:38.837078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:38.837705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:38.838020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:38.838345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:38.848483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:38.849970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:38.864013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:38.864973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:38.866297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:38.866297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:38.866297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:38.866297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:38.866297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 607/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:38.871564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:38.970332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1175df4-de06-4af7-8882-cac1b347d569 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:38.972590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:39.004817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:39.005425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:39.005704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:39.006009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:39.006845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:39.007143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:39.009926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:39.021820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 622/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:39.027891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:39.037315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:39.138292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca21d25-746d-4230-a2fb-6a0dadb3baf2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:39.173898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:39.174524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:39.174803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:39.175157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:39.182571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:39.184029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:06:39.195229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:39.197867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:39.199115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 608/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:39.203437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:39.301894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a13c-ab7f-4a67-b204-8448af3509f0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:39.336070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca99b0-12c9-42b0-81e7-57053f0b4d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:39.336819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca99b0-12c9-42b0-81e7-57053f0b4d4a None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:39.337107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca99b0-12c9-42b0-81e7-57053f0b4d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:39.337444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca99b0-12c9-42b0-81e7-57053f0b4d4a None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:39.338219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca99b0-12c9-42b0-81e7-57053f0b4d4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:39.338530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca99b0-12c9-42b0-81e7-57053f0b4d4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:39.340019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca99b0-12c9-42b0-81e7-57053f0b4d4a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:39.352055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 623/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:39.358232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:39.427217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:39.463838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1053a1-1285-4a79-9302-d0101fe11696 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:39.497011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96944693-55c3-46cc-9826-1b009d551371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:39.497656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944693-55c3-46cc-9826-1b009d551371 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:39.497965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944693-55c3-46cc-9826-1b009d551371 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:39.498241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944693-55c3-46cc-9826-1b009d551371 None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/41aaa2d337974ae29ef28b1126e70435/roles/2e815411a02a4cf19b45effcfbb0896c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:39.512730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96944693-55c3-46cc-9826-1b009d551371 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=41aaa2d337974ae29ef28b1126e70435, role_id=2e815411a02a4cf19b45effcfbb0896c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:39.514743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96944693-55c3-46cc-9826-1b009d551371 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:39.582190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 609/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:06:39 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/41aaa2d337974ae29ef28b1126e70435/roles/2e815411a02a4cf19b45effcfbb0896c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:41.589462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e9283-5bd5-40fe-b927-3f59b41472f6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:41.590106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e9283-5bd5-40fe-b927-3f59b41472f6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:41.590106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e9283-5bd5-40fe-b927-3f59b41472f6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:41.591450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 624/1233] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:41.596612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b766bc-e206-4ce7-9822-a1a963e061a6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:41.597147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b766bc-e206-4ce7-9822-a1a963e061a6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:41.597468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b766bc-e206-4ce7-9822-a1a963e061a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:41.616392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-55b766bc-e206-4ce7-9822-a1a963e061a6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:41.617566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-55b766bc-e206-4ce7-9822-a1a963e061a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:41.682382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 610/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:41.705014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e9283-5bd5-40fe-b927-3f59b41472f6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:41.731911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:41.809317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e9283-5bd5-40fe-b927-3f59b41472f6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:41.844624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:41.845188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:41.845472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:41.845774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:41.857494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:06:41.862465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:41.863480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:41.864346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 625/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Tue Aug 2 09:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:41.870408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b766bc-e206-4ce7-9822-a1a963e061a6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:41.917294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:41.968850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b766bc-e206-4ce7-9822-a1a963e061a6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:42.002707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:42.003352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:42.003634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:42.003912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:42.004633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:42.004939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:42.006418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:42.015088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 611/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Tue Aug 2 09:06:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:42.020817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:42.106887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:42.122135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a14ed8-ec12-4f91-94e2-2437afc825b0 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:42.155108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:42.155737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:42.156021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:42.156298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:42.166140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:42.167588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:42.184405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:42.185423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:42.186825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:42.186825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:42.186825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:42.186825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:42.186825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 626/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:42.191357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:42.291848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381fbf-906e-43e5-8e32-bf404e62436e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:42.300526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:42.325643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:42.326312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:42.326594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:42.326874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:42.327563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:42.327872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:42.329242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:42.341050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 612/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:42.346839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:42.447380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ca3c-fb2d-4a0f-8247-bdafdd4dc822 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:42.480008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:42.480631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:42.480914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:42.481189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:42.483857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:42.488682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:42.490194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:06:42.501630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:42.506568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:42.507881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 627/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:42.509230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:42.607585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db420dc2-46fd-460a-93cb-c3ba24d6ff98 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:42.641240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:42.641879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:42.642158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:42.642430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:42.643208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:42.643536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:42.645037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:42.662747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 613/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Tue Aug 2 09:06:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:06:42.668623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:42.768106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72a8f8-a422-4510-9453-e43e764f0303 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:42.800881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:42.801484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:42.801793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:42.802070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:42.863513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:42.872366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:42.873920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:42.984635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 628/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:06:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:06:42.990469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:43.018480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:43.089885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb883d-db87-4f10-ad0f-0e166dff0ac1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:43.122767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:43.123392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:43.123670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:43.123944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:43.134167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:43.135613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:43.150571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:43.159911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:43.160827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:43.160827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:43.160827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:43.160827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:43.160827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 614/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:43.161118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:43.249504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:43.255285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eda1c-d663-4c9a-ada8-a3c18be84d6c None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:43.289918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:43.290469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:43.290750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:43.291023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:43.291708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:43.292016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:43.293639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:43.304567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 629/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:43.310872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:43.393462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:43.414778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32369-12f8-479b-8ca0-cb2d2dcd9dcd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:43.447949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:43.448585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:43.448870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:43.449151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:43.455723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:43.457172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:06:43.468899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:43.470014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:43.475018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 615/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:43.476272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:43.579614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9392da1-e208-45c5-9971-8e06abb1556f None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:43.612949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774dc4-37f7-473f-a0c9-0b3675a2457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:43.613559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774dc4-37f7-473f-a0c9-0b3675a2457f None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:43.613880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774dc4-37f7-473f-a0c9-0b3675a2457f None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:43.614154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774dc4-37f7-473f-a0c9-0b3675a2457f None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:43.614894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774dc4-37f7-473f-a0c9-0b3675a2457f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:43.615198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774dc4-37f7-473f-a0c9-0b3675a2457f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:43.616615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774dc4-37f7-473f-a0c9-0b3675a2457f None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:43.629058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 630/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:43.635324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:43.734686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725be8f-40cc-4233-82fb-6cb9e9ba5163 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:43.768967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067da51-a9e7-4b57-a03e-8b3d2919c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:43.769697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067da51-a9e7-4b57-a03e-8b3d2919c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:43.769998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067da51-a9e7-4b57-a03e-8b3d2919c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:43.770291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067da51-a9e7-4b57-a03e-8b3d2919c3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:43.771066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067da51-a9e7-4b57-a03e-8b3d2919c3c9 None admin] RBAC: Adding query filter params (role.id=2e815411a02a4cf19b45effcfbb0896c, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=41aaa2d337974ae29ef28b1126e70435) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:43.771375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067da51-a9e7-4b57-a03e-8b3d2919c3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:43.772817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067da51-a9e7-4b57-a03e-8b3d2919c3c9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:43.779449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 616/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:06:43 2022] GET /identity/v3/role_assignments?user.id=41aaa2d337974ae29ef28b1126e70435&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=2e815411a02a4cf19b45effcfbb0896c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:45.971189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9a672-2053-452e-b70d-5db77ac35e33 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:45.971760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9a672-2053-452e-b70d-5db77ac35e33 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:45.971760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9a672-2053-452e-b70d-5db77ac35e33 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:45.973065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 631/1247] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:45.979016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003bf73-425c-4193-8576-dd83a8f321fe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:45.979436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003bf73-425c-4193-8576-dd83a8f321fe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:45.979561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003bf73-425c-4193-8576-dd83a8f321fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:45.985991 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:45.998065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f003bf73-425c-4193-8576-dd83a8f321fe None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:46.003097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f003bf73-425c-4193-8576-dd83a8f321fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:46.064706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 617/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:46.088791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9a672-2053-452e-b70d-5db77ac35e33 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:46.107918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:46.190662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9a672-2053-452e-b70d-5db77ac35e33 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:46.225633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:46.226286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:46.227203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:46.227498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:46.237597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:06:46.242729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:46.255694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:46.256820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 632/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:46.258285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003bf73-425c-4193-8576-dd83a8f321fe None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:46.350577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003bf73-425c-4193-8576-dd83a8f321fe None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:46.380715 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:46.386611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:46.387239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:46.387525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:46.387805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:46.388522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:46.388829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:46.390297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:46.398354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 618/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:46.404896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:46.482816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:46.505777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d002-0361-424c-97bf-f4d74e317326 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:46.540043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:46.540703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:46.540988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:46.541264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:46.551198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:46.556667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:46.567087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:46.568182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:46.569328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:46.569328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:46.569328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:46.569328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:46.569328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 633/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:46.574764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:46.674029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0d37-e696-43ac-9148-258063ef337c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:46.707927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:46.708538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:46.708824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:46.709102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:46.709856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:46.710166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:46.711584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:46.723011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 619/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:46.731224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:46.834222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fe38-7262-43fa-9b58-b86f281e4422 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:46.861461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:46.869492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:46.870224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:46.870511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:46.870790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:46.879631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:46.881080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:06:46.893192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:46.894499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:46.895758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 634/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:46.901039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:46.956510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:47.000190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031a8c-3075-4ef1-b8c1-625832b4c879 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:47.034295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:47.034910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:47.035192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:47.035467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:47.036283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:47.036588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:47.038122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:47.055192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 620/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Tue Aug 2 09:06:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:47.061141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:47.162549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6ec1-8d02-48e9-a86b-7651c1d890a5 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:47.196022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:47.196644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:47.196931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:47.197211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:47.251629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:47.264122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:47.265577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:47.365136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 635/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:06:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:06:47.371057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:47.469996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df06ac-6568-4e7d-a39f-d94cc84dd786 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:47.483348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:47.504449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:47.505076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:47.505354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:47.505626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:47.516522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:47.518045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:47.532497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:47.533556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:47.534713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:47.534713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:47.534713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:47.534713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:47.534713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 621/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:47.539432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:47.629610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:47.643833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce926b-f1da-466b-afb7-0250d4d9ccd7 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:47.685220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:47.685869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:47.686158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:47.686439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:47.687126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:47.687432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:47.688862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:47.701384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 636/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:06:47.707240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:47.807512 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d284-3f5f-4de6-bd29-05062ed1ea6f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:47.841071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:47.841702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:47.842017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:47.842295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:47.848950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:47.850691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:06:47.862920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:47.863942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:47.865087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 622/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:47.875486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:47.985179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c625-564f-407f-809d-1b1155da6ffd None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:48.022583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b020e67-f58b-474c-af53-415448f0bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:48.023191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020e67-f58b-474c-af53-415448f0bd9d None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:48.023673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020e67-f58b-474c-af53-415448f0bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:48.024053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020e67-f58b-474c-af53-415448f0bd9d None admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:48.024826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b020e67-f58b-474c-af53-415448f0bd9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:48.025127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b020e67-f58b-474c-af53-415448f0bd9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:48.026623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b020e67-f58b-474c-af53-415448f0bd9d None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:48.038251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 637/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:48.044923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:48.072188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:48.153015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d78d-b267-4e52-9b8b-b59b0db40bef None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:48.186946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dd5b3-1481-4862-8512-0f5750078ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:48.187553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd5b3-1481-4862-8512-0f5750078ccd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:48.187834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd5b3-1481-4862-8512-0f5750078ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:48.188109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd5b3-1481-4862-8512-0f5750078ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:48.188899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd5b3-1481-4862-8512-0f5750078ccd None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=41aaa2d337974ae29ef28b1126e70435) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:48.189200 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd5b3-1481-4862-8512-0f5750078ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:48.190749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd5b3-1481-4862-8512-0f5750078ccd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:48.196683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 623/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:06:48 2022] GET /identity/v3/role_assignments?user.id=41aaa2d337974ae29ef28b1126e70435&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:50.256350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192958-dbc1-41d9-8e8f-85714c2f4eb5 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:50.256936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192958-dbc1-41d9-8e8f-85714c2f4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:50.256936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192958-dbc1-41d9-8e8f-85714c2f4eb5 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:50.258873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 638/1261] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:50.264465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a10e96-8f28-4069-a5a7-9bf06a3f7e06 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:50.265076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a10e96-8f28-4069-a5a7-9bf06a3f7e06 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:50.265380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a10e96-8f28-4069-a5a7-9bf06a3f7e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:50.287054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-08a10e96-8f28-4069-a5a7-9bf06a3f7e06 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:50.288300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-08a10e96-8f28-4069-a5a7-9bf06a3f7e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:50.377489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 624/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:50.410403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192958-dbc1-41d9-8e8f-85714c2f4eb5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:50.422341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:50.532649 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192958-dbc1-41d9-8e8f-85714c2f4eb5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:50.576122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:50.576766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:50.577044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:50.577335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:50.589545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:06:50.594542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:50.595669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:50.596806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 639/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:50.602315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a10e96-8f28-4069-a5a7-9bf06a3f7e06 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:50.621811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:50.711275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a10e96-8f28-4069-a5a7-9bf06a3f7e06 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:50.750809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:50.751431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:50.751707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:50.751978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:50.752697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:50.752998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:50.754392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:50.764724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 625/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:50.770926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:50.842260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:50.877284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc29d-970c-417d-9319-beac69307340 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:50.909968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:50.910593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:50.910873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:50.911143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:50.922231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:50.924812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:50.938530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:50.939586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:50.940530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:50.940530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:50.940530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:50.940530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:50.940530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 640/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:50.947140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:51.030205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:51.049777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de73b-8c7a-4e2d-adb7-ba2814dd2741 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:51.083533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:51.084151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:51.084435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:51.084713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:51.085404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:51.085774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:51.087153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:51.102983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 626/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:06:51.108822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:51.222643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4ff6f-e781-49b4-ba71-1fa12a76d927 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:51.243451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:51.258010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:51.258803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:51.258928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:51.259207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:51.266687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:51.268126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:06:51.279856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:51.281056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:51.286061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 641/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:51.287174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:51.392614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40590a-2ca8-4e4e-9c18-e29bd86c4cd4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:51.426717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:51.427354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:51.427638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:51.427916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:51.428701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:51.429009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:51.430568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:51.439174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:51.447903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 627/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Tue Aug 2 09:06:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:51.453763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:51.555072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2ffa4-df48-4f68-95d0-0e32abfb6a80 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:51.589809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:51.590450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:51.590795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:51.591073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:51.602003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:51.603498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:51.617514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:51.618604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:51.619574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:51.619574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:51.619574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:51.619574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:51.619574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 642/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:51.624428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:51.728060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0427-a80d-47b1-8c77-dff6fda71e25 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:51.765785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:51.766557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:51.766901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:51.767253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:51.767949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:51.768284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:51.769760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:51.781830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 628/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:51.787495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:51.821314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:51.891198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d66f45-a3cf-4481-bb34-0cd48941ab6b None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:51.925482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:51.926140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:51.926423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:51.926700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:51.933667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:51.935213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:06:51.949031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:51.953893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:51.954841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 643/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:51.956911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:52.021942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:52.067633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99311d0-0a6c-4504-81b9-a7a3c974af6f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:52.101106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d580449-4d3b-4457-9660-c67039e5b8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:52.101838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d580449-4d3b-4457-9660-c67039e5b8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:52.102160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d580449-4d3b-4457-9660-c67039e5b8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:52.102431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d580449-4d3b-4457-9660-c67039e5b8b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:52.103177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d580449-4d3b-4457-9660-c67039e5b8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:52.103484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d580449-4d3b-4457-9660-c67039e5b8b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:52.104913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d580449-4d3b-4457-9660-c67039e5b8b0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:52.118019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 629/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:06:52.124581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:52.218181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:52.226906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756021b-296c-44b6-8195-6997f5122784 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:52.262274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3121-cf2e-473e-8afe-69b040b8cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:52.263043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3121-cf2e-473e-8afe-69b040b8cc7a None admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:52.263326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3121-cf2e-473e-8afe-69b040b8cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:52.263602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3121-cf2e-473e-8afe-69b040b8cc7a None admin] PATH_INFO: `/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/41aaa2d337974ae29ef28b1126e70435/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:52.265486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3121-cf2e-473e-8afe-69b040b8cc7a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4f4acb124c5ba3528dcf05233ee2, user_id=41aaa2d337974ae29ef28b1126e70435, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:52.267073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3121-cf2e-473e-8afe-69b040b8cc7a None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:52.370877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 644/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Tue Aug 2 09:06:52 2022] PUT /identity/v3/projects/7e7e4f4acb124c5ba3528dcf05233ee2/users/41aaa2d337974ae29ef28b1126e70435/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:06:54.412256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b7b0e-cc07-4bdb-b3da-ac545f89e077 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:54.412808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b7b0e-cc07-4bdb-b3da-ac545f89e077 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:54.412808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b7b0e-cc07-4bdb-b3da-ac545f89e077 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:54.414860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 630/1274] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:54.420120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a03b7e-b5ff-4002-b7da-90dcad3b0b8e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:54.420554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a03b7e-b5ff-4002-b7da-90dcad3b0b8e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:54.420667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a03b7e-b5ff-4002-b7da-90dcad3b0b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:54.438615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d5a03b7e-b5ff-4002-b7da-90dcad3b0b8e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:54.439802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d5a03b7e-b5ff-4002-b7da-90dcad3b0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:54.509116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 645/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:54.532896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b7b0e-cc07-4bdb-b3da-ac545f89e077 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:54.634687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b7b0e-cc07-4bdb-b3da-ac545f89e077 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:54.651731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:54.668670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:54.669237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:54.669535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:54.669842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:54.680375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:06:54.685510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:54.686674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:54.687940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 631/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Tue Aug 2 09:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:54.692896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a03b7e-b5ff-4002-b7da-90dcad3b0b8e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:54.773849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:54.792503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a03b7e-b5ff-4002-b7da-90dcad3b0b8e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:54.827211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:54.827838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:54.828123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:54.828399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:54.829117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:54.829425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:54.830821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:54.839310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 646/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Tue Aug 2 09:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:54.845147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:54.959957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd790-ff8c-42d6-be1b-f5b23e325a48 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:54.997143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:54.997832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:54.998122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:54.998401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:55.008920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:55.010425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:55.026454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:55.032500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:55.033423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:55.033423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:55.033423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:55.033423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:55.033423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 632/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:55.033742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:55.143182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a8106-d9ad-48e2-913a-8e6b19d4d201 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:55.177989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:55.178639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:55.178925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:55.179210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:55.180081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:55.180435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:55.181827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:55.193401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 647/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:55.199495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:55.231815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:55.302659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d8105-c6a4-4d67-b4d6-379b5299ae5a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:55.340106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:55.340748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:55.341031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:55.341305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:55.348656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:55.351072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:06:55.361847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:55.362985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:55.364309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 633/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:55.368951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:55.372721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:55.468473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e40e7-6c3e-4f41-a9a9-5ab7efdf8e1e None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:55.504395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:55.504928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:55.505206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:55.505478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:55.506374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:55.506877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:55.509659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:55.528338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 648/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Tue Aug 2 09:06:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:55.534101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:55.638220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:55.647537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c43cac-86b4-4b53-a658-b5e71874722e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:55.681620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:55.682259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:55.682537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:55.682812 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:55.750552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:55.752021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:55.841400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:55.851940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 634/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Tue Aug 2 09:06:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:06:55.861127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:55.919065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:55.959305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807e97-e6b8-40d2-a021-83d5303bf452 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:56.016608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:56.017399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:56.017744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:56.018065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:56.030257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:56.031894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:06:56.050289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:56.051399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:56.052300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:06:56.052300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:06:56.052300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:06:56.052300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:56.052300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 649/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:56.058491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:56.167045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf70e4-f4b3-4365-a7f3-eced7591c600 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:56.206074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:56.206990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:56.207446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:56.207722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:56.208475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:56.208889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:56.210695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:56.224227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 635/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Tue Aug 2 09:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:56.230869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:56.349228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f02a-eb94-4c38-a933-2c5fef4fa1fa None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:56.364262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:56.386287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:56.386929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:56.387211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:56.387486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:56.394699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:56.396307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:06:56.411654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:56.412908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:06:56.414644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 650/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Tue Aug 2 09:06:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:06:56.421634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:56.482086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:56.532216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f18604-938c-4ba6-a1b1-62ce15e4d290 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:56.566378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efd3e9-1e51-41a7-8dd1-2acac6257443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:56.567008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd3e9-1e51-41a7-8dd1-2acac6257443 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:56.567258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd3e9-1e51-41a7-8dd1-2acac6257443 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:56.567537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd3e9-1e51-41a7-8dd1-2acac6257443 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:56.568284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd3e9-1e51-41a7-8dd1-2acac6257443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:56.568592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd3e9-1e51-41a7-8dd1-2acac6257443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:56.570272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd3e9-1e51-41a7-8dd1-2acac6257443 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:56.582748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 636/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Tue Aug 2 09:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:56.589847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:56.691437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3caed2-eeef-4407-9730-f1b6e8f7bb42 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:56.728987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06901-1005-4c81-a0f6-b71222540f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:56.729601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06901-1005-4c81-a0f6-b71222540f45 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:56.729908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06901-1005-4c81-a0f6-b71222540f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:56.730189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06901-1005-4c81-a0f6-b71222540f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:56.730981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06901-1005-4c81-a0f6-b71222540f45 None admin] RBAC: Adding query filter params (role.id=f94dc1ad1f1d4d84887223ee766cae73, scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2, user.id=41aaa2d337974ae29ef28b1126e70435) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:56.731291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06901-1005-4c81-a0f6-b71222540f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:56.732756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06901-1005-4c81-a0f6-b71222540f45 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:56.738780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 651/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Tue Aug 2 09:06:56 2022] GET /identity/v3/role_assignments?user.id=41aaa2d337974ae29ef28b1126e70435&scope.project.id=7e7e4f4acb124c5ba3528dcf05233ee2&role.id=f94dc1ad1f1d4d84887223ee766cae73 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:58.786446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2da4e-3a72-4bab-9cff-3f3bd4cdf0cf None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:58.786980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2da4e-3a72-4bab-9cff-3f3bd4cdf0cf None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:58.786980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2da4e-3a72-4bab-9cff-3f3bd4cdf0cf None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:58.788337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 637/1288] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:06:58.794371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888dfcd-d6a3-4dbc-875b-14ca68d8ac1c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:58.795036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888dfcd-d6a3-4dbc-875b-14ca68d8ac1c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:58.795283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888dfcd-d6a3-4dbc-875b-14ca68d8ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:58.813798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6888dfcd-d6a3-4dbc-875b-14ca68d8ac1c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:06:58.822993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6888dfcd-d6a3-4dbc-875b-14ca68d8ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:06:58.846439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:58.886021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 652/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:06:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:06:58.908137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2da4e-3a72-4bab-9cff-3f3bd4cdf0cf None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:59.008557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2da4e-3a72-4bab-9cff-3f3bd4cdf0cf None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:59.018989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:06:59.042525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:59.043148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:59.043438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:59.043717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:59.044344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:59.045744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:06:59.054907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:06:59.060982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:06:59.062024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 638/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:06:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:06:59.063029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888dfcd-d6a3-4dbc-875b-14ca68d8ac1c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:59.161266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888dfcd-d6a3-4dbc-875b-14ca68d8ac1c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:59.194106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abd1cd-0864-4ea0-9755-e862aab75a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:59.194707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abd1cd-0864-4ea0-9755-e862aab75a34 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:59.195510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abd1cd-0864-4ea0-9755-e862aab75a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:59.195789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abd1cd-0864-4ea0-9755-e862aab75a34 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:59.196462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abd1cd-0864-4ea0-9755-e862aab75a34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:59.196765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abd1cd-0864-4ea0-9755-e862aab75a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:59.198215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abd1cd-0864-4ea0-9755-e862aab75a34 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:59.202954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 653/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Tue Aug 2 09:06:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:06:59.208969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:06:59.308878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe83f2-3143-45b4-9f25-753bc05db4bf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:06:59.342137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c4a2d-573f-44c5-bb4f-540a009554d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:06:59.342741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c4a2d-573f-44c5-bb4f-540a009554d2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:06:59.343027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c4a2d-573f-44c5-bb4f-540a009554d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:06:59.343306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c4a2d-573f-44c5-bb4f-540a009554d2 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:06:59.343976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c4a2d-573f-44c5-bb4f-540a009554d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:06:59.344285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c4a2d-573f-44c5-bb4f-540a009554d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:06:59.345655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c4a2d-573f-44c5-bb4f-540a009554d2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:06:59.350017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 639/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Tue Aug 2 09:06:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:07:01.384465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566caaf7-14fd-4a8e-a507-782130161265 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:01.385032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566caaf7-14fd-4a8e-a507-782130161265 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:01.385032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566caaf7-14fd-4a8e-a507-782130161265 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:01.386483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 654/1293] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:07:01.391590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d0a9-12f4-409d-8b2a-215fda5ccb95 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:01.391987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d0a9-12f4-409d-8b2a-215fda5ccb95 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:01.392137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d0a9-12f4-409d-8b2a-215fda5ccb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:01.410532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-97c9d0a9-12f4-409d-8b2a-215fda5ccb95 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:01.411732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-97c9d0a9-12f4-409d-8b2a-215fda5ccb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:01.440227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:01.477853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 640/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:07:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:07:01.500105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566caaf7-14fd-4a8e-a507-782130161265 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:01.532387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:01.604399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566caaf7-14fd-4a8e-a507-782130161265 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:01.638166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e6f9a-08cf-4051-ae96-ff4683e79903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:01.638690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6f9a-08cf-4051-ae96-ff4683e79903 None admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:01.638972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6f9a-08cf-4051-ae96-ff4683e79903 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:01.639248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6f9a-08cf-4051-ae96-ff4683e79903 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:01.639941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e6f9a-08cf-4051-ae96-ff4683e79903 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:01.641303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e6f9a-08cf-4051-ae96-ff4683e79903 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:01.707492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 655/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Tue Aug 2 09:07:01 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:07:03.770133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e551f8a-6bef-4823-a65c-600d2090c2ed None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:03.770699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e551f8a-6bef-4823-a65c-600d2090c2ed None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:03.770699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e551f8a-6bef-4823-a65c-600d2090c2ed None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:03.772079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 641/1296] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:07:03.777974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf409e9-8c32-4b5f-8b86-99c7d0f2b9b8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:03.778769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf409e9-8c32-4b5f-8b86-99c7d0f2b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:03.778769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf409e9-8c32-4b5f-8b86-99c7d0f2b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:03.797265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-baf409e9-8c32-4b5f-8b86-99c7d0f2b9b8 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:03.801800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-baf409e9-8c32-4b5f-8b86-99c7d0f2b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:03.880417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 656/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:07:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:07:03.903250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e551f8a-6bef-4823-a65c-600d2090c2ed None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:04.004163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e551f8a-6bef-4823-a65c-600d2090c2ed None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:04.038053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:04.038730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:04.039461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:04.039737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:04.040354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:04.041740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:07:04.050351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:07:04.055747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:07:04.056660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 642/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:07:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:07:04.058110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf409e9-8c32-4b5f-8b86-99c7d0f2b9b8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:04.076961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:04.158047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf409e9-8c32-4b5f-8b86-99c7d0f2b9b8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:04.190768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:04.191372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:04.191709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:04.191985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:04.192649 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:07:04.192951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:04.194343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:04.200289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 657/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Tue Aug 2 09:07:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:07:04.206273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:04.237947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:04.305078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9150-86aa-4cb4-a499-82fce495f560 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:04.338066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2026d67-9fa9-40f8-9903-43ad1928303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:04.338687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026d67-9fa9-40f8-9903-43ad1928303a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:04.338970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026d67-9fa9-40f8-9903-43ad1928303a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:04.339244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026d67-9fa9-40f8-9903-43ad1928303a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:04.339995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026d67-9fa9-40f8-9903-43ad1928303a None admin] RBAC: Adding query filter params (interface=public, service_id=0721b4e64f6346729e7408a2c092601e, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:07:04.340303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026d67-9fa9-40f8-9903-43ad1928303a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:04.341680 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026d67-9fa9-40f8-9903-43ad1928303a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:04.346775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 643/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Tue Aug 2 09:07:04 2022] GET /identity/v3/endpoints?service_id=0721b4e64f6346729e7408a2c092601e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:07:04.353894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:04.435940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:04.454475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe854d3-a0e4-4a98-933d-aadc559e4827 None admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:04.488819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4174554-8faa-4aec-a178-9186d767b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:04.489430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174554-8faa-4aec-a178-9186d767b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:04.489730 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174554-8faa-4aec-a178-9186d767b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:04.490018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174554-8faa-4aec-a178-9186d767b7c3 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:04.490665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174554-8faa-4aec-a178-9186d767b7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:04.492742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174554-8faa-4aec-a178-9186d767b7c3 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:04.499491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 658/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Tue Aug 2 09:07:04 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:07:06.512587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912bb64-e692-4f9b-a4e1-ad742dd0cdf9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.513178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912bb64-e692-4f9b-a4e1-ad742dd0cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.513178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912bb64-e692-4f9b-a4e1-ad742dd0cdf9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.514520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 644/1302] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:07:06.519749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e7e1-2f0b-4139-9b4b-89751d0702ed None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.520149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e7e1-2f0b-4139-9b4b-89751d0702ed None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.524787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e7e1-2f0b-4139-9b4b-89751d0702ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.538109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5927e7e1-2f0b-4139-9b4b-89751d0702ed None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:07:06.540208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5927e7e1-2f0b-4139-9b4b-89751d0702ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:07:06.605392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 659/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:07:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:07:06.628335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912bb64-e692-4f9b-a4e1-ad742dd0cdf9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:06.723193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:06.730864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912bb64-e692-4f9b-a4e1-ad742dd0cdf9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:06.763916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:06.764537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.764823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.765099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.765736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:06.767120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:07:06.776057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:07:06.777325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:07:06.778448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 645/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Tue Aug 2 09:07:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:07:06.783365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e7e1-2f0b-4139-9b4b-89751d0702ed None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:06.859519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:06.883726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e7e1-2f0b-4139-9b4b-89751d0702ed None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:06.919419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8650-236f-4c18-89f2-86958943c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:06.920031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8650-236f-4c18-89f2-86958943c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:06.920314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8650-236f-4c18-89f2-86958943c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:06.920588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8650-236f-4c18-89f2-86958943c5d5 None admin] PATH_INFO: `/v3/services` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:06.921252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8650-236f-4c18-89f2-86958943c5d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:07:06.921554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8650-236f-4c18-89f2-86958943c5d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:06.922986 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8650-236f-4c18-89f2-86958943c5d5 None admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:06.927992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 660/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Tue Aug 2 09:07:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:07:06.934117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:07:07.035732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf59911-77df-4948-a36a-e54df0131ab6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:07:07.069302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35248141-69c0-4fcc-a911-adbfa7432983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:07:07.070103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248141-69c0-4fcc-a911-adbfa7432983 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:07:07.070387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248141-69c0-4fcc-a911-adbfa7432983 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:07:07.070689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248141-69c0-4fcc-a911-adbfa7432983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:07:07.071529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35248141-69c0-4fcc-a911-adbfa7432983 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:07:07.072977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35248141-69c0-4fcc-a911-adbfa7432983 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:07:07.188829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 646/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:07:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:07:16.924969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=30 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:07:17.184207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:08.732537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731841fc-3bb4-401f-b6e1-06090df9fc43 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:08.737083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731841fc-3bb4-401f-b6e1-06090df9fc43 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:08.737083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731841fc-3bb4-401f-b6e1-06090df9fc43 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:08.739745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b370ec-06f3-4a6d-83c2-b2cb952150f5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:08.740290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b370ec-06f3-4a6d-83c2-b2cb952150f5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:08.740413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b370ec-06f3-4a6d-83c2-b2cb952150f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:08.745141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 661/1307] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:08.825143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-08b370ec-06f3-4a6d-83c2-b2cb952150f5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:08.829262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-08b370ec-06f3-4a6d-83c2-b2cb952150f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:09.006137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 647/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:14:09.039738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0edaa-ef2b-4bba-a782-7877ad0e5bff None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:09.040127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0edaa-ef2b-4bba-a782-7877ad0e5bff None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:09.040554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0edaa-ef2b-4bba-a782-7877ad0e5bff None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:09.042474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 662/1309] 10.222.0.71 () {54 vars in 965 bytes} [Tue Aug 2 09:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:09.048385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d36d-2af9-4841-8322-f8feea69be4f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:09.048789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d36d-2af9-4841-8322-f8feea69be4f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:09.048940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d36d-2af9-4841-8322-f8feea69be4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:09.150753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5033d36d-2af9-4841-8322-f8feea69be4f None None] MFA Rules not processed for user `8f8fdc63709648dfbefb06f1b2db7ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:09.152017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5033d36d-2af9-4841-8322-f8feea69be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:09.175539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:09.240479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 648/1310] 10.222.0.71 () {58 vars in 1062 bytes} [Tue Aug 2 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:09.250793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0edaa-ef2b-4bba-a782-7877ad0e5bff None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:09.252835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e5e0edaa-ef2b-4bba-a782-7877ad0e5bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:09.375219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0edaa-ef2b-4bba-a782-7877ad0e5bff None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:09.464007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11807b5-8c7d-435b-85ca-d5ff97db5292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:09.464754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11807b5-8c7d-435b-85ca-d5ff97db5292 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:09.465048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11807b5-8c7d-435b-85ca-d5ff97db5292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:09.465475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11807b5-8c7d-435b-85ca-d5ff97db5292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:09.467509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c11807b5-8c7d-435b-85ca-d5ff97db5292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:09.534434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:09.595106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11807b5-8c7d-435b-85ca-d5ff97db5292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:09.596566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11807b5-8c7d-435b-85ca-d5ff97db5292 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:09.619634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 663/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:11.968109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f31b4-03d2-4877-8800-8fcd85c08c73 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:11.968685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f31b4-03d2-4877-8800-8fcd85c08c73 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:11.968685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f31b4-03d2-4877-8800-8fcd85c08c73 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:11.970313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 649/1312] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:11.976399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc438c-0b21-4d3e-ba43-f8c4a7a999f5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:11.976943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc438c-0b21-4d3e-ba43-f8c4a7a999f5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:11.976943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc438c-0b21-4d3e-ba43-f8c4a7a999f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:12.071400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9afc438c-0b21-4d3e-ba43-f8c4a7a999f5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:12.072636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9afc438c-0b21-4d3e-ba43-f8c4a7a999f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:12.180484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 664/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:12.219911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f31b4-03d2-4877-8800-8fcd85c08c73 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:12.221520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5e7f31b4-03d2-4877-8800-8fcd85c08c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:12.328284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f31b4-03d2-4877-8800-8fcd85c08c73 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:12.399598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:12.402094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a68d40-ee0b-46b3-94e4-98cfe0a8c1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:12.402709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68d40-ee0b-46b3-94e4-98cfe0a8c1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:12.402989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68d40-ee0b-46b3-94e4-98cfe0a8c1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:12.403264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68d40-ee0b-46b3-94e4-98cfe0a8c1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:12.404896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-69a68d40-ee0b-46b3-94e4-98cfe0a8c1e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:12.513268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a68d40-ee0b-46b3-94e4-98cfe0a8c1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:12.514755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a68d40-ee0b-46b3-94e4-98cfe0a8c1e6 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:12.532903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 650/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:15.036217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89474f-c676-4ffd-aa1f-6def206b98bb None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:15.037312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89474f-c676-4ffd-aa1f-6def206b98bb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:15.037312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89474f-c676-4ffd-aa1f-6def206b98bb None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:15.038780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 665/1315] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:15.043900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527f31-f96a-4e6a-aa4c-eb49d0fd9a73 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:15.044295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527f31-f96a-4e6a-aa4c-eb49d0fd9a73 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:15.044482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527f31-f96a-4e6a-aa4c-eb49d0fd9a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:15.111395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-62527f31-f96a-4e6a-aa4c-eb49d0fd9a73 None None] MFA Rules not processed for user `3b45245f45504e11bd9ec34cfbb1962c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:15.112876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-62527f31-f96a-4e6a-aa4c-eb49d0fd9a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:15.165376 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:15.210997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 651/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:15.250946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89474f-c676-4ffd-aa1f-6def206b98bb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:15.252508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9e89474f-c676-4ffd-aa1f-6def206b98bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:15.262172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:15.356078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89474f-c676-4ffd-aa1f-6def206b98bb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:15.428197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e65a3e-d0f5-4db3-95a3-1b7c66a61540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:15.428808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65a3e-d0f5-4db3-95a3-1b7c66a61540 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:15.429092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65a3e-d0f5-4db3-95a3-1b7c66a61540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:15.429367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65a3e-d0f5-4db3-95a3-1b7c66a61540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:15.431009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91e65a3e-d0f5-4db3-95a3-1b7c66a61540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:15.492269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:15.539056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65a3e-d0f5-4db3-95a3-1b7c66a61540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:15.540492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65a3e-d0f5-4db3-95a3-1b7c66a61540 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:15.559048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 666/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:18.394001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece40cf-d25e-4600-b0c3-a769b78b934a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:18.394529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece40cf-d25e-4600-b0c3-a769b78b934a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:18.394639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece40cf-d25e-4600-b0c3-a769b78b934a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:18.395911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 652/1318] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:18.401131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96474-d9f7-45b5-a2f8-6a3fe1e5554c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:18.401535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96474-d9f7-45b5-a2f8-6a3fe1e5554c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:18.401690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96474-d9f7-45b5-a2f8-6a3fe1e5554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:18.467164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4ed96474-d9f7-45b5-a2f8-6a3fe1e5554c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:18.468385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4ed96474-d9f7-45b5-a2f8-6a3fe1e5554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:18.564953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 667/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:18.604828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece40cf-d25e-4600-b0c3-a769b78b934a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:18.606436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0ece40cf-d25e-4600-b0c3-a769b78b934a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:18.708137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece40cf-d25e-4600-b0c3-a769b78b934a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:18.779363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb1377-77ee-485d-8714-694196ad19c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:18.779973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1377-77ee-485d-8714-694196ad19c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:18.780252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1377-77ee-485d-8714-694196ad19c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:18.780527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1377-77ee-485d-8714-694196ad19c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:18.782162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5deb1377-77ee-485d-8714-694196ad19c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:18.790037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:18.889583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb1377-77ee-485d-8714-694196ad19c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:18.891063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb1377-77ee-485d-8714-694196ad19c3 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:18.908776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 653/1320] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:21.857016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077dad3-8935-403f-95dc-5f71a9efc5be None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:21.857525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077dad3-8935-403f-95dc-5f71a9efc5be None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:21.857525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077dad3-8935-403f-95dc-5f71a9efc5be None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:21.859011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 668/1321] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:21.867187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dfe8c-8ffb-4e4f-a80e-e8141dcd36ab None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:21.867187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dfe8c-8ffb-4e4f-a80e-e8141dcd36ab None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:21.867187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dfe8c-8ffb-4e4f-a80e-e8141dcd36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:21.932223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-773dfe8c-8ffb-4e4f-a80e-e8141dcd36ab None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:21.933438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-773dfe8c-8ffb-4e4f-a80e-e8141dcd36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:21.993055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:22.032647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 654/1322] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:22.070065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077dad3-8935-403f-95dc-5f71a9efc5be None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:22.071655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7077dad3-8935-403f-95dc-5f71a9efc5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:22.092921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:22.187641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077dad3-8935-403f-95dc-5f71a9efc5be None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:22.267400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb1c9d-e587-48ca-b2e1-c0a3a7349b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:22.268024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb1c9d-e587-48ca-b2e1-c0a3a7349b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:22.268307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb1c9d-e587-48ca-b2e1-c0a3a7349b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:22.268585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb1c9d-e587-48ca-b2e1-c0a3a7349b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:22.270279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8efb1c9d-e587-48ca-b2e1-c0a3a7349b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:22.346430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:22.386060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb1c9d-e587-48ca-b2e1-c0a3a7349b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:22.387508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb1c9d-e587-48ca-b2e1-c0a3a7349b1b service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:22.406023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 669/1323] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:24.492170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e6ec-8dac-4687-bf29-242178092fae None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:24.492704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e6ec-8dac-4687-bf29-242178092fae None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:24.492704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e6ec-8dac-4687-bf29-242178092fae None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:24.494225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 655/1324] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:24.499311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0d1c-8fa1-4c42-818b-23e3df09adfb None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:24.499712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0d1c-8fa1-4c42-818b-23e3df09adfb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:24.499869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0d1c-8fa1-4c42-818b-23e3df09adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:24.565668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ed7b0d1c-8fa1-4c42-818b-23e3df09adfb None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:24.566902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ed7b0d1c-8fa1-4c42-818b-23e3df09adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:24.664017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 670/1325] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:24.700581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1e6ec-8dac-4687-bf29-242178092fae None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:24.702162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-77c1e6ec-8dac-4687-bf29-242178092fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:24.804736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1e6ec-8dac-4687-bf29-242178092fae None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:24.880604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e2436-ac93-4933-a821-88bcdb13452c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:24.881271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e2436-ac93-4933-a821-88bcdb13452c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:24.881552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e2436-ac93-4933-a821-88bcdb13452c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:24.881862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e2436-ac93-4933-a821-88bcdb13452c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:24.883491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0a0e2436-ac93-4933-a821-88bcdb13452c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:24.901482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:24.996944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e2436-ac93-4933-a821-88bcdb13452c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:24.998563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e2436-ac93-4933-a821-88bcdb13452c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:25.019666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 656/1326] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:27.142337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7ec4-6b87-40b7-ad4b-6fd9b39421fa None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:27.142887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7ec4-6b87-40b7-ad4b-6fd9b39421fa None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:27.142887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7ec4-6b87-40b7-ad4b-6fd9b39421fa None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:27.144206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 671/1327] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:27.149499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e999f9-5e19-44f1-a736-c1a905c4fc0a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:27.149967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e999f9-5e19-44f1-a736-c1a905c4fc0a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:27.150224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e999f9-5e19-44f1-a736-c1a905c4fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:27.222663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-99e999f9-5e19-44f1-a736-c1a905c4fc0a None None] MFA Rules not processed for user `3b45245f45504e11bd9ec34cfbb1962c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:27.223888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-99e999f9-5e19-44f1-a736-c1a905c4fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:27.292715 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:27.324310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 657/1328] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:27.363335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7ec4-6b87-40b7-ad4b-6fd9b39421fa None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:27.365098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-364a7ec4-6b87-40b7-ad4b-6fd9b39421fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:27.399312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:27.480397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7ec4-6b87-40b7-ad4b-6fd9b39421fa None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:27.556424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e4f20-1ffe-40ca-b419-644119830c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:27.557045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4f20-1ffe-40ca-b419-644119830c77 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:27.557328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4f20-1ffe-40ca-b419-644119830c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:27.557603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4f20-1ffe-40ca-b419-644119830c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:27.559248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9e2e4f20-1ffe-40ca-b419-644119830c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:27.637828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:27.670414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e4f20-1ffe-40ca-b419-644119830c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:27.672043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e4f20-1ffe-40ca-b419-644119830c77 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:27.692089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 672/1329] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:30.243080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75ed7-f4b8-4204-b4c7-abc35d96db9e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.243646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75ed7-f4b8-4204-b4c7-abc35d96db9e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.243646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75ed7-f4b8-4204-b4c7-abc35d96db9e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.244999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 658/1330] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:30.250195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7bc57-7b7b-48d8-b2d8-0f671b21222e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.250609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7bc57-7b7b-48d8-b2d8-0f671b21222e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.250767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7bc57-7b7b-48d8-b2d8-0f671b21222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.316113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-86b7bc57-7b7b-48d8-b2d8-0f671b21222e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:30.317322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-86b7bc57-7b7b-48d8-b2d8-0f671b21222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:30.417415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 673/1331] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:30.454172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb75ed7-f4b8-4204-b4c7-abc35d96db9e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:30.455718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8fb75ed7-f4b8-4204-b4c7-abc35d96db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:30.561924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb75ed7-f4b8-4204-b4c7-abc35d96db9e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:30.635290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc221236-9af1-43ca-8680-5df62e6c554c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:30.635903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221236-9af1-43ca-8680-5df62e6c554c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:30.636190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221236-9af1-43ca-8680-5df62e6c554c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:30.636488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221236-9af1-43ca-8680-5df62e6c554c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:30.638140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc221236-9af1-43ca-8680-5df62e6c554c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:30.665356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:30.748556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc221236-9af1-43ca-8680-5df62e6c554c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:30.750046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc221236-9af1-43ca-8680-5df62e6c554c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:30.767923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 659/1332] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:32.823198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6abda-d4c2-408f-8d87-7be5354d433b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:32.823785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6abda-d4c2-408f-8d87-7be5354d433b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:32.823785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6abda-d4c2-408f-8d87-7be5354d433b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:32.825113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 674/1333] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:32.830352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f16b5-2d29-42ab-b04a-a58dadea38a7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:32.830794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f16b5-2d29-42ab-b04a-a58dadea38a7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:32.830913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f16b5-2d29-42ab-b04a-a58dadea38a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:32.897501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b95f16b5-2d29-42ab-b04a-a58dadea38a7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:32.898761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b95f16b5-2d29-42ab-b04a-a58dadea38a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:32.973582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:32.996231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 660/1334] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:33.037417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6abda-d4c2-408f-8d87-7be5354d433b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:33.038990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-63d6abda-d4c2-408f-8d87-7be5354d433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:33.079659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:33.143781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6abda-d4c2-408f-8d87-7be5354d433b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:33.218527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf972cd-9e16-4380-8b80-31f80e87ce58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:33.219138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf972cd-9e16-4380-8b80-31f80e87ce58 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:33.219418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf972cd-9e16-4380-8b80-31f80e87ce58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:33.219726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf972cd-9e16-4380-8b80-31f80e87ce58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:33.221340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fdf972cd-9e16-4380-8b80-31f80e87ce58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:33.305565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:33.331408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf972cd-9e16-4380-8b80-31f80e87ce58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:33.333078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf972cd-9e16-4380-8b80-31f80e87ce58 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:33.351637 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 675/1335] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:36.013333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6160-7a7b-4ceb-845f-df05094ed793 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:36.013918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6160-7a7b-4ceb-845f-df05094ed793 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:36.013918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb6160-7a7b-4ceb-845f-df05094ed793 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:36.015298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 661/1336] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:36.020355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17505cc-e7a2-45bc-a29a-fd90baf92ecf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:36.020745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17505cc-e7a2-45bc-a29a-fd90baf92ecf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:36.020953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17505cc-e7a2-45bc-a29a-fd90baf92ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:36.086378 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c17505cc-e7a2-45bc-a29a-fd90baf92ecf None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:36.087584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c17505cc-e7a2-45bc-a29a-fd90baf92ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:36.184108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 676/1337] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:36.221843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb6160-7a7b-4ceb-845f-df05094ed793 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:36.223357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4efb6160-7a7b-4ceb-845f-df05094ed793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:36.334363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb6160-7a7b-4ceb-845f-df05094ed793 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:36.406424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f644f7f-95e1-44ad-b36e-f1768a1f13a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:36.407036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644f7f-95e1-44ad-b36e-f1768a1f13a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:36.407319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644f7f-95e1-44ad-b36e-f1768a1f13a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:36.407596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644f7f-95e1-44ad-b36e-f1768a1f13a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:36.409207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7f644f7f-95e1-44ad-b36e-f1768a1f13a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:36.444630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:36.516915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f644f7f-95e1-44ad-b36e-f1768a1f13a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:36.518382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f644f7f-95e1-44ad-b36e-f1768a1f13a5 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:36.537502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 662/1338] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:40.703384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ec77a-7ff4-4594-9247-4b042eb055ef None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:40.703384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ec77a-7ff4-4594-9247-4b042eb055ef None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:40.703384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ec77a-7ff4-4594-9247-4b042eb055ef None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:40.704564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 677/1339] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:40.710632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b743c5b-42c0-4e4d-a36f-5ab18b37752a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:40.711168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b743c5b-42c0-4e4d-a36f-5ab18b37752a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:40.711546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b743c5b-42c0-4e4d-a36f-5ab18b37752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:40.781589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6b743c5b-42c0-4e4d-a36f-5ab18b37752a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:40.782874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6b743c5b-42c0-4e4d-a36f-5ab18b37752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:40.873971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:40.885967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 663/1340] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:40.936804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecfe8d-9135-43be-b5e7-5ee1f418bde7 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:40.937309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecfe8d-9135-43be-b5e7-5ee1f418bde7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:40.937585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecfe8d-9135-43be-b5e7-5ee1f418bde7 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:40.939022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 678/1341] 10.222.0.71 () {54 vars in 965 bytes} [Tue Aug 2 09:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:40.945443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920cb3b-b017-4f12-9304-bf395bf159ad None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:40.945847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920cb3b-b017-4f12-9304-bf395bf159ad None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:40.946131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920cb3b-b017-4f12-9304-bf395bf159ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:41.023939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a920cb3b-b017-4f12-9304-bf395bf159ad None None] MFA Rules not processed for user `8f8fdc63709648dfbefb06f1b2db7ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:41.025140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a920cb3b-b017-4f12-9304-bf395bf159ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:41.102149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 664/1342] 10.222.0.71 () {58 vars in 1062 bytes} [Tue Aug 2 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:41.110934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecfe8d-9135-43be-b5e7-5ee1f418bde7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:41.112713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-73ecfe8d-9135-43be-b5e7-5ee1f418bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:41.162778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:41.219708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecfe8d-9135-43be-b5e7-5ee1f418bde7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:41.294477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbac9c-7d49-459f-8c3c-2971832a5aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:41.295084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbac9c-7d49-459f-8c3c-2971832a5aed service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:41.295361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbac9c-7d49-459f-8c3c-2971832a5aed service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:41.295635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbac9c-7d49-459f-8c3c-2971832a5aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:41.297242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6ffbac9c-7d49-459f-8c3c-2971832a5aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:41.394247 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:41.411362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbac9c-7d49-459f-8c3c-2971832a5aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:41.412819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbac9c-7d49-459f-8c3c-2971832a5aed service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:41.430800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 679/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:45.092696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7eb6c-1abb-46eb-8786-f55353091296 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:45.093266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7eb6c-1abb-46eb-8786-f55353091296 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:45.093363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7eb6c-1abb-46eb-8786-f55353091296 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:45.094818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 665/1344] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:45.100896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264f1f7-c904-4daa-8724-cb711f0c2d80 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:45.101382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264f1f7-c904-4daa-8724-cb711f0c2d80 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:45.101494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264f1f7-c904-4daa-8724-cb711f0c2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:45.167728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9264f1f7-c904-4daa-8724-cb711f0c2d80 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:45.168855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9264f1f7-c904-4daa-8724-cb711f0c2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:45.266896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 680/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:45.305869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7eb6c-1abb-46eb-8786-f55353091296 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:45.307460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0ff7eb6c-1abb-46eb-8786-f55353091296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:45.408922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:45.429175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7eb6c-1abb-46eb-8786-f55353091296 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:45.512242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8baf5-4c14-47eb-943a-e0c3b6f0a91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:45.512828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8baf5-4c14-47eb-943a-e0c3b6f0a91e service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:45.513100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8baf5-4c14-47eb-943a-e0c3b6f0a91e service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:45.513377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8baf5-4c14-47eb-943a-e0c3b6f0a91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:45.515042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dac8baf5-4c14-47eb-943a-e0c3b6f0a91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:45.632266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8baf5-4c14-47eb-943a-e0c3b6f0a91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:45.633798 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8baf5-4c14-47eb-943a-e0c3b6f0a91e service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:45.654336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 666/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:14:49.908999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544886a-092b-4818-9746-54b1e60e6b43 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:49.909539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544886a-092b-4818-9746-54b1e60e6b43 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:49.909539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544886a-092b-4818-9746-54b1e60e6b43 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:49.910966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 681/1347] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:49.917379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061da23-6859-499e-ab80-b2c7229a5ea3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:49.917892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061da23-6859-499e-ab80-b2c7229a5ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:49.918010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061da23-6859-499e-ab80-b2c7229a5ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:49.939085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:49.997999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4061da23-6859-499e-ab80-b2c7229a5ea3 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:49.999384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4061da23-6859-499e-ab80-b2c7229a5ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:50.107503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 667/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:14:50.148881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544886a-092b-4818-9746-54b1e60e6b43 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:14:50.150683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a544886a-092b-4818-9746-54b1e60e6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:50.214032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:50.265873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544886a-092b-4818-9746-54b1e60e6b43 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:14:50.344902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03319791-a122-452d-903a-2f6a762159f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:14:50.345527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03319791-a122-452d-903a-2f6a762159f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:50.345842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03319791-a122-452d-903a-2f6a762159f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:50.346250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03319791-a122-452d-903a-2f6a762159f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:50.347911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-03319791-a122-452d-903a-2f6a762159f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:50.467767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:50.471232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03319791-a122-452d-903a-2f6a762159f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:14:50.472736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03319791-a122-452d-903a-2f6a762159f5 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:14:50.492421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 682/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:14:55.497118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7ddd1-c3c8-469e-8228-f8396a748467 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:55.497656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7ddd1-c3c8-469e-8228-f8396a748467 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:55.497656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7ddd1-c3c8-469e-8228-f8396a748467 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:55.499541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 668/1350] 10.222.0.71 () {54 vars in 921 bytes} [Tue Aug 2 09:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:14:55.506542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacc1a8-247a-4102-afe4-b341364cae50 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:14:55.506542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacc1a8-247a-4102-afe4-b341364cae50 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:14:55.507000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacc1a8-247a-4102-afe4-b341364cae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:14:55.603121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1bacc1a8-247a-4102-afe4-b341364cae50 None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:14:55.604521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1bacc1a8-247a-4102-afe4-b341364cae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:14:55.783214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 683/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Tue Aug 2 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:00.076825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7074-bc54-4607-a759-02535c665d89 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:00.077395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7074-bc54-4607-a759-02535c665d89 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:00.077395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7074-bc54-4607-a759-02535c665d89 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:00.078939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 669/1352] 10.222.0.71 () {54 vars in 921 bytes} [Tue Aug 2 09:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:00.084680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed338ce-a62e-4937-82fa-f85b95242cba None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:00.085590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed338ce-a62e-4937-82fa-f85b95242cba None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:00.086146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed338ce-a62e-4937-82fa-f85b95242cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:00.105489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=59 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:00.147822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:00.172135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0ed338ce-a62e-4937-82fa-f85b95242cba None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:00.173497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0ed338ce-a62e-4937-82fa-f85b95242cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:00.292651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 684/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Tue Aug 2 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:01.667940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b58ab-3e94-4818-96da-ef30036f7164 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:01.668503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b58ab-3e94-4818-96da-ef30036f7164 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:01.668503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b58ab-3e94-4818-96da-ef30036f7164 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:01.670350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 670/1354] 10.222.0.71 () {54 vars in 921 bytes} [Tue Aug 2 09:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:01.674875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfae32-8dfb-47b5-886f-124cd5cefdc9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:01.675267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfae32-8dfb-47b5-886f-124cd5cefdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:01.675419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfae32-8dfb-47b5-886f-124cd5cefdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:01.754172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-24bfae32-8dfb-47b5-886f-124cd5cefdc9 None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:01.756482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-24bfae32-8dfb-47b5-886f-124cd5cefdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:01.799001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:01.869012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 685/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Tue Aug 2 09:15:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:15:05.273569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa825-b706-485b-84e1-c1f3dbb8a279 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:05.274085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa825-b706-485b-84e1-c1f3dbb8a279 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:05.274085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa825-b706-485b-84e1-c1f3dbb8a279 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:05.275336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 671/1356] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:05.281294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700357c-88d7-494a-a4bf-262760275c79 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:05.281798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700357c-88d7-494a-a4bf-262760275c79 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:05.282007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700357c-88d7-494a-a4bf-262760275c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:05.360595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2700357c-88d7-494a-a4bf-262760275c79 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:05.361834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2700357c-88d7-494a-a4bf-262760275c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:05.477025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 686/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:05.528567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ce9b-ed59-40c3-8823-798154541bf7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:05.529478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ce9b-ed59-40c3-8823-798154541bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:05.529975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ce9b-ed59-40c3-8823-798154541bf7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:05.531735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 672/1358] 10.222.0.71 () {54 vars in 962 bytes} [Tue Aug 2 09:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:05.550784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475285c6-c89d-406d-afe1-72bae64f5d0d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:05.551105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475285c6-c89d-406d-afe1-72bae64f5d0d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:05.551378 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475285c6-c89d-406d-afe1-72bae64f5d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:05.573204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:05.640913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-475285c6-c89d-406d-afe1-72bae64f5d0d None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:05.642241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-475285c6-c89d-406d-afe1-72bae64f5d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:05.765667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 687/1359] 10.222.0.71 () {58 vars in 1059 bytes} [Tue Aug 2 09:15:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:15:05.775455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ce9b-ed59-40c3-8823-798154541bf7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:05.777084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ebd7ce9b-ed59-40c3-8823-798154541bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:05.945907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ce9b-ed59-40c3-8823-798154541bf7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:06.027718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:06.070264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1da00f-f0a9-492b-90d6-12dcc1e78771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:06.070891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1da00f-f0a9-492b-90d6-12dcc1e78771 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:06.071181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1da00f-f0a9-492b-90d6-12dcc1e78771 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:06.071479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1da00f-f0a9-492b-90d6-12dcc1e78771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:06.073196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ba1da00f-f0a9-492b-90d6-12dcc1e78771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:06.168804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1da00f-f0a9-492b-90d6-12dcc1e78771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:06.170470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1da00f-f0a9-492b-90d6-12dcc1e78771 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:06.190199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 673/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:08.437932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0568-7240-4953-ac5a-375466f94681 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:08.438480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0568-7240-4953-ac5a-375466f94681 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:08.438480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0568-7240-4953-ac5a-375466f94681 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:08.440041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 688/1361] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:15:08.446046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f48d-ce4d-4b22-84d9-bf334fb2abc0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:08.446563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f48d-ce4d-4b22-84d9-bf334fb2abc0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:08.446660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f48d-ce4d-4b22-84d9-bf334fb2abc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:08.517830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0146f48d-ce4d-4b22-84d9-bf334fb2abc0 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:08.518969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0146f48d-ce4d-4b22-84d9-bf334fb2abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:08.558939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:08.626086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 674/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:08.672544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa0568-7240-4953-ac5a-375466f94681 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:08.674266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2dfa0568-7240-4953-ac5a-375466f94681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:08.757376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:08.845881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa0568-7240-4953-ac5a-375466f94681 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:08.990145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249bb6d-7633-4529-b63f-988d8245b163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:08.990849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249bb6d-7633-4529-b63f-988d8245b163 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:08.991196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249bb6d-7633-4529-b63f-988d8245b163 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:08.991536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249bb6d-7633-4529-b63f-988d8245b163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:08.993435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8249bb6d-7633-4529-b63f-988d8245b163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:09.018029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:09.089764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249bb6d-7633-4529-b63f-988d8245b163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:09.091678 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249bb6d-7633-4529-b63f-988d8245b163 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:09.112201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 689/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:11.645847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b74df-a816-4a8a-9894-0ad5df1af63e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:11.646540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b74df-a816-4a8a-9894-0ad5df1af63e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:11.646540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b74df-a816-4a8a-9894-0ad5df1af63e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:11.647734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 675/1364] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:11.653005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5455c3-f570-488b-affb-ec6875767c42 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:11.653886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5455c3-f570-488b-affb-ec6875767c42 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:11.654565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5455c3-f570-488b-affb-ec6875767c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:11.725352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ad5455c3-f570-488b-affb-ec6875767c42 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:11.726626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ad5455c3-f570-488b-affb-ec6875767c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:11.826667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:11.829766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 690/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:11.881899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e234-13d9-4f68-98d9-cdcb23aaff03 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:11.882337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e234-13d9-4f68-98d9-cdcb23aaff03 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:11.882690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e234-13d9-4f68-98d9-cdcb23aaff03 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:11.884598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 676/1366] 10.222.0.71 () {54 vars in 962 bytes} [Tue Aug 2 09:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:11.889908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcfc6-8af1-4925-9d78-44c5bad75118 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:11.892762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcfc6-8af1-4925-9d78-44c5bad75118 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:11.892762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcfc6-8af1-4925-9d78-44c5bad75118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:11.974820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-292fcfc6-8af1-4925-9d78-44c5bad75118 None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:11.976182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-292fcfc6-8af1-4925-9d78-44c5bad75118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:12.105094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 691/1367] 10.222.0.71 () {58 vars in 1059 bytes} [Tue Aug 2 09:15:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:12.113013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e234-13d9-4f68-98d9-cdcb23aaff03 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:12.115595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4522e234-13d9-4f68-98d9-cdcb23aaff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:12.275219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e234-13d9-4f68-98d9-cdcb23aaff03 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:12.297959 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:12.408298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751658eb-b6ed-4aa2-8964-effdfd8b3e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:12.408918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751658eb-b6ed-4aa2-8964-effdfd8b3e10 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:12.409195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751658eb-b6ed-4aa2-8964-effdfd8b3e10 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:12.409470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751658eb-b6ed-4aa2-8964-effdfd8b3e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:12.411278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-751658eb-b6ed-4aa2-8964-effdfd8b3e10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:12.511874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751658eb-b6ed-4aa2-8964-effdfd8b3e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:12.513494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751658eb-b6ed-4aa2-8964-effdfd8b3e10 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:12.536448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 677/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:13.440786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79237-cc79-4a82-8956-13cd74742aee None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:13.441321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79237-cc79-4a82-8956-13cd74742aee None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:13.441321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79237-cc79-4a82-8956-13cd74742aee None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:13.443074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 692/1369] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:13.448130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c758b-bc13-4e20-88a8-86be37d5799a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:13.448571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c758b-bc13-4e20-88a8-86be37d5799a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:13.448744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c758b-bc13-4e20-88a8-86be37d5799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:13.481623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:13.519801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2e1c758b-bc13-4e20-88a8-86be37d5799a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:13.522673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2e1c758b-bc13-4e20-88a8-86be37d5799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:13.630049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 678/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:13.979596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c586341-7840-46ee-bddc-5c11785cf20d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:13.979596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c586341-7840-46ee-bddc-5c11785cf20d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:13.979596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c586341-7840-46ee-bddc-5c11785cf20d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:13.979596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 693/1371] 10.222.0.71 () {54 vars in 964 bytes} [Tue Aug 2 09:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:13.987076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8900166-05ea-42e6-b325-b0ad10ad0f12 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:13.987538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8900166-05ea-42e6-b325-b0ad10ad0f12 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:13.988111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8900166-05ea-42e6-b325-b0ad10ad0f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:14.074246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a8900166-05ea-42e6-b325-b0ad10ad0f12 None None] MFA Rules not processed for user `06a2008ab3a2497eba5e8394277c2316`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:14.075684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a8900166-05ea-42e6-b325-b0ad10ad0f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:14.126714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:14.157402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 679/1372] 10.222.0.71 () {58 vars in 1061 bytes} [Tue Aug 2 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:14.165482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c586341-7840-46ee-bddc-5c11785cf20d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:14.167132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5c586341-7840-46ee-bddc-5c11785cf20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:14.220787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:14.281058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c586341-7840-46ee-bddc-5c11785cf20d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:14.362590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849e8fb-1be4-4ae3-b029-732c382329f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:14.363593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e8fb-1be4-4ae3-b029-732c382329f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:14.364512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e8fb-1be4-4ae3-b029-732c382329f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:14.364840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e8fb-1be4-4ae3-b029-732c382329f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:14.366670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c849e8fb-1be4-4ae3-b029-732c382329f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:14.471662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:14.487126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849e8fb-1be4-4ae3-b029-732c382329f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:14.489757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849e8fb-1be4-4ae3-b029-732c382329f5 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:14.509898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 694/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:14.787847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d239-8efc-4e05-8357-2f073a0c6b9e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:14.787847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d239-8efc-4e05-8357-2f073a0c6b9e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:14.788529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d239-8efc-4e05-8357-2f073a0c6b9e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:14.794341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 680/1374] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:14.797147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db66eb1-b500-4a73-bf1c-90f2aca834c5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:14.797676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db66eb1-b500-4a73-bf1c-90f2aca834c5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:14.797975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db66eb1-b500-4a73-bf1c-90f2aca834c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:14.880377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4db66eb1-b500-4a73-bf1c-90f2aca834c5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:14.880377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4db66eb1-b500-4a73-bf1c-90f2aca834c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:14.992356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 695/1375] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:15.037428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62d239-8efc-4e05-8357-2f073a0c6b9e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:15.039044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2e62d239-8efc-4e05-8357-2f073a0c6b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:15.188256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62d239-8efc-4e05-8357-2f073a0c6b9e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:15.240205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:15.306851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7803f90-6920-4ac0-954b-24b9e0f518d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:15.307528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803f90-6920-4ac0-954b-24b9e0f518d1 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:15.308151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803f90-6920-4ac0-954b-24b9e0f518d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:15.308740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803f90-6920-4ac0-954b-24b9e0f518d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:15.311100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7803f90-6920-4ac0-954b-24b9e0f518d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:15.402182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7803f90-6920-4ac0-954b-24b9e0f518d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:15.403788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7803f90-6920-4ac0-954b-24b9e0f518d1 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:15.421348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 681/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:17.627888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1c65-cb0b-4835-ac32-c6afea5d8348 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:17.628438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1c65-cb0b-4835-ac32-c6afea5d8348 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:17.628438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1c65-cb0b-4835-ac32-c6afea5d8348 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:17.630479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 696/1377] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:17.635764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c908-79fc-414b-97a4-093bf149de08 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:17.636177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c908-79fc-414b-97a4-093bf149de08 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:17.636328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c908-79fc-414b-97a4-093bf149de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:17.728628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-90e5c908-79fc-414b-97a4-093bf149de08 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:17.729791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-90e5c908-79fc-414b-97a4-093bf149de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:17.736292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:17.828343 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 682/1378] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:17.872874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1c65-cb0b-4835-ac32-c6afea5d8348 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:17.874495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-665c1c65-cb0b-4835-ac32-c6afea5d8348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:17.944061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:18.047576 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1c65-cb0b-4835-ac32-c6afea5d8348 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:18.209209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf2e8e-64fa-4403-9d96-3c093008134f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:18.210245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2e8e-64fa-4403-9d96-3c093008134f service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:18.210738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2e8e-64fa-4403-9d96-3c093008134f service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:18.211216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2e8e-64fa-4403-9d96-3c093008134f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:18.214894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-20bf2e8e-64fa-4403-9d96-3c093008134f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:18.239543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:18.316647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf2e8e-64fa-4403-9d96-3c093008134f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:18.319458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf2e8e-64fa-4403-9d96-3c093008134f service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:18.338982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 697/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:20.505005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab931-f13a-4565-8359-1a7a60c99464 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:20.505657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab931-f13a-4565-8359-1a7a60c99464 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:20.505657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab931-f13a-4565-8359-1a7a60c99464 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:20.512386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590045b-4e1f-471a-8d00-aeaa2f3b1519 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:20.512982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590045b-4e1f-471a-8d00-aeaa2f3b1519 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:20.512982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590045b-4e1f-471a-8d00-aeaa2f3b1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:20.516456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 683/1380] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:20.586304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5590045b-4e1f-471a-8d00-aeaa2f3b1519 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:20.587534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5590045b-4e1f-471a-8d00-aeaa2f3b1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:20.698776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:20.704916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 698/1381] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:20.751056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab931-f13a-4565-8359-1a7a60c99464 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:20.752561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6a6ab931-f13a-4565-8359-1a7a60c99464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:20.896052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:20.907303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab931-f13a-4565-8359-1a7a60c99464 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:21.043023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f28074-7c02-4f1e-bc6c-879243c6dd7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:21.043657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28074-7c02-4f1e-bc6c-879243c6dd7c service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:21.043939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28074-7c02-4f1e-bc6c-879243c6dd7c service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:21.044217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28074-7c02-4f1e-bc6c-879243c6dd7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:21.045972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-68f28074-7c02-4f1e-bc6c-879243c6dd7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:21.144990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f28074-7c02-4f1e-bc6c-879243c6dd7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:21.147328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f28074-7c02-4f1e-bc6c-879243c6dd7c service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:21.158416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:21.167064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 684/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:23.715792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8e6c-1b86-42f5-8c76-ca1c916878c8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:23.716367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8e6c-1b86-42f5-8c76-ca1c916878c8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:23.716367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8e6c-1b86-42f5-8c76-ca1c916878c8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:23.717737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 699/1383] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:23.723118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dd2cf-d269-4a4a-9705-a3b282dd3435 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:23.723866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dd2cf-d269-4a4a-9705-a3b282dd3435 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:23.724150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dd2cf-d269-4a4a-9705-a3b282dd3435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:23.798400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-700dd2cf-d269-4a4a-9705-a3b282dd3435 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:23.799615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-700dd2cf-d269-4a4a-9705-a3b282dd3435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:23.905320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 685/1384] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:23.948359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f8e6c-1b86-42f5-8c76-ca1c916878c8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:23.949977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7a7f8e6c-1b86-42f5-8c76-ca1c916878c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:24.110968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f8e6c-1b86-42f5-8c76-ca1c916878c8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:24.181320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:24.228921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a83a8-8a71-4129-bf7c-71a6bd8624be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:24.229533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a83a8-8a71-4129-bf7c-71a6bd8624be service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:24.229845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a83a8-8a71-4129-bf7c-71a6bd8624be service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:24.230179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a83a8-8a71-4129-bf7c-71a6bd8624be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:24.231739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-786a83a8-8a71-4129-bf7c-71a6bd8624be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:24.324558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a83a8-8a71-4129-bf7c-71a6bd8624be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:24.326202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a83a8-8a71-4129-bf7c-71a6bd8624be service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:24.345765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 700/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:26.361492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819494-fc8f-4443-a6c2-86141e2d8e35 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:26.362086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819494-fc8f-4443-a6c2-86141e2d8e35 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:26.362242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819494-fc8f-4443-a6c2-86141e2d8e35 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:26.364878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 686/1386] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:26.371190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc1fa7-4223-426b-b2ee-d40f6ee82935 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:26.371758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc1fa7-4223-426b-b2ee-d40f6ee82935 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:26.371876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc1fa7-4223-426b-b2ee-d40f6ee82935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:26.450422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-77cc1fa7-4223-426b-b2ee-d40f6ee82935 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:26.451871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-77cc1fa7-4223-426b-b2ee-d40f6ee82935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:26.489790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:26.556298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 701/1387] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:26.612256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819494-fc8f-4443-a6c2-86141e2d8e35 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:26.614541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d6819494-fc8f-4443-a6c2-86141e2d8e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:26.698660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:26.778009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819494-fc8f-4443-a6c2-86141e2d8e35 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:26.900448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699154f4-4dba-48c7-99cb-98bfeeef2fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:26.901237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699154f4-4dba-48c7-99cb-98bfeeef2fe1 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:26.901598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699154f4-4dba-48c7-99cb-98bfeeef2fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:26.902092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699154f4-4dba-48c7-99cb-98bfeeef2fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:26.904323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-699154f4-4dba-48c7-99cb-98bfeeef2fe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:26.950168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:27.008001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699154f4-4dba-48c7-99cb-98bfeeef2fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:27.009608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699154f4-4dba-48c7-99cb-98bfeeef2fe1 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:27.028897 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 687/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:29.161861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8079626-4b71-4d6a-97b2-e9ab6afab921 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:29.162425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8079626-4b71-4d6a-97b2-e9ab6afab921 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:29.162425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8079626-4b71-4d6a-97b2-e9ab6afab921 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:29.165758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 702/1389] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:29.169231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760b51-907b-4803-8fb5-5025f11bc1db None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:29.169664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760b51-907b-4803-8fb5-5025f11bc1db None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:29.169984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760b51-907b-4803-8fb5-5025f11bc1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:29.239284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-31760b51-907b-4803-8fb5-5025f11bc1db None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:29.240504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-31760b51-907b-4803-8fb5-5025f11bc1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:29.337752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 688/1390] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:29.382590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8079626-4b71-4d6a-97b2-e9ab6afab921 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:29.384152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c8079626-4b71-4d6a-97b2-e9ab6afab921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:29.532080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8079626-4b71-4d6a-97b2-e9ab6afab921 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:29.548674 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:29.648011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb5c16-cc2e-4a7a-b01f-974f2ca42bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:29.648635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb5c16-cc2e-4a7a-b01f-974f2ca42bcc service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:29.648917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb5c16-cc2e-4a7a-b01f-974f2ca42bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:29.649193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb5c16-cc2e-4a7a-b01f-974f2ca42bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:29.650852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a3cb5c16-cc2e-4a7a-b01f-974f2ca42bcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:29.742968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb5c16-cc2e-4a7a-b01f-974f2ca42bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:29.744570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb5c16-cc2e-4a7a-b01f-974f2ca42bcc service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:29.764570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 703/1391] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:30.096653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40cd03-7fb1-49bd-a767-8d610d0db4d7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:30.097018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40cd03-7fb1-49bd-a767-8d610d0db4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:30.097304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40cd03-7fb1-49bd-a767-8d610d0db4d7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:30.099260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 689/1392] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:30.104643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78ba4-d4ed-4ffa-a933-e282ee76621d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:30.104986 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78ba4-d4ed-4ffa-a933-e282ee76621d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:30.105222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78ba4-d4ed-4ffa-a933-e282ee76621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:30.132356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:30.173961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a4b78ba4-d4ed-4ffa-a933-e282ee76621d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:30.175172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a4b78ba4-d4ed-4ffa-a933-e282ee76621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:30.273166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 704/1393] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:30.328573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f2fc-7d86-433a-ac48-56e41918085f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:30.329057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f2fc-7d86-433a-ac48-56e41918085f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:30.329157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715f2fc-7d86-433a-ac48-56e41918085f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:30.330491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 690/1394] 10.222.0.71 () {54 vars in 966 bytes} [Tue Aug 2 09:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:30.336291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7c46-0fe9-4d0c-8aef-a80cda17b683 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:30.336584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7c46-0fe9-4d0c-8aef-a80cda17b683 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:30.336869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7c46-0fe9-4d0c-8aef-a80cda17b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:30.416729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ea7e7c46-0fe9-4d0c-8aef-a80cda17b683 None None] MFA Rules not processed for user `71adb0143db64ca68f9c3846951adb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:30.417994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ea7e7c46-0fe9-4d0c-8aef-a80cda17b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:30.459495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:30.495572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 705/1395] 10.222.0.71 () {58 vars in 1063 bytes} [Tue Aug 2 09:15:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:30.503100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f2fc-7d86-433a-ac48-56e41918085f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:30.504605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0715f2fc-7d86-433a-ac48-56e41918085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:30.518067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:30.611225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715f2fc-7d86-433a-ac48-56e41918085f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:30.687199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec5778-afcf-4bab-8561-32294ec61ada service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adb0143db64ca68f9c3846951adb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:30.687821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec5778-afcf-4bab-8561-32294ec61ada service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:30.688108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec5778-afcf-4bab-8561-32294ec61ada service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:30.688386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec5778-afcf-4bab-8561-32294ec61ada service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:30.690034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f0ec5778-afcf-4bab-8561-32294ec61ada service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:30.759748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:30.799989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec5778-afcf-4bab-8561-32294ec61ada service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:30.802034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec5778-afcf-4bab-8561-32294ec61ada service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:30.819641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 691/1396] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:31.720689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb9eb1-39fa-4bea-8474-8ba3aa13d13d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:31.721270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb9eb1-39fa-4bea-8474-8ba3aa13d13d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:31.721516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb9eb1-39fa-4bea-8474-8ba3aa13d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:31.794546 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-62fb9eb1-39fa-4bea-8474-8ba3aa13d13d None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:31.795919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-62fb9eb1-39fa-4bea-8474-8ba3aa13d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:31.888511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 706/1397] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:15:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:31.935015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1afee1-2e00-4d5a-b169-0c71c6be8ce8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:31.935531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1afee1-2e00-4d5a-b169-0c71c6be8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:31.935637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1afee1-2e00-4d5a-b169-0c71c6be8ce8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:31.936989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 692/1398] 10.222.0.71 () {54 vars in 943 bytes} [Tue Aug 2 09:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:31.944443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:31.944733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:31.945009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:31.953114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57d18-215c-4806-ad5b-7b9ccaa5ff8b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:31.953399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57d18-215c-4806-ad5b-7b9ccaa5ff8b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:31.953705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57d18-215c-4806-ad5b-7b9ccaa5ff8b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:31.955073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 693/1399] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:15:31.960348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:31.960575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:31.960857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:32.018681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:32.026383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] MFA Rules not processed for user `72bd8d0e197643a58f5becd38d1ab474`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:32.027605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:32.030216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:32.031389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:32.132185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 694/1400] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:15:32.138591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 707/1401] 10.222.0.71 () {58 vars in 1040 bytes} [Tue Aug 2 09:15:31 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:32.147958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:32.149145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:32.175814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:32.178591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:32.179816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:32.255533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e0f4c-3cb6-4320-b7c2-0887e9f783ac None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:32.278697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fb947-2025-4184-8db3-2ed1f60973d8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:32.370609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad42a2-5d59-47e1-8522-fb420626e373 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:32.370960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad42a2-5d59-47e1-8522-fb420626e373 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:32.371243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad42a2-5d59-47e1-8522-fb420626e373 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:32.371523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad42a2-5d59-47e1-8522-fb420626e373 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:32.373307 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7fad42a2-5d59-47e1-8522-fb420626e373 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:32.420981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:32.424330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:32.464592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad42a2-5d59-47e1-8522-fb420626e373 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:32.466229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad42a2-5d59-47e1-8522-fb420626e373 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:32.475045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 695/1402] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:15:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:15:32.521589 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1208f5-4256-44d6-aa85-205856bd8873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:32.522155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1208f5-4256-44d6-aa85-205856bd8873 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:32.522435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1208f5-4256-44d6-aa85-205856bd8873 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:32.522707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1208f5-4256-44d6-aa85-205856bd8873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:32.524358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4f1208f5-4256-44d6-aa85-205856bd8873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:32.615141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1208f5-4256-44d6-aa85-205856bd8873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:32.616730 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1208f5-4256-44d6-aa85-205856bd8873 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:32.635096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 708/1403] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:34.794474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f58e-fcec-43eb-a4aa-93df6450ddf2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:34.795082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f58e-fcec-43eb-a4aa-93df6450ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:34.795082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f58e-fcec-43eb-a4aa-93df6450ddf2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:34.796384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 696/1404] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:34.801588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b69b5-d69e-4b96-b540-5c40f0813ff6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:34.802067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b69b5-d69e-4b96-b540-5c40f0813ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:34.802160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b69b5-d69e-4b96-b540-5c40f0813ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:34.839882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:34.892140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-886b69b5-d69e-4b96-b540-5c40f0813ff6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:34.892803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-886b69b5-d69e-4b96-b540-5c40f0813ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:35.007520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 709/1405] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:35.054339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f58e-fcec-43eb-a4aa-93df6450ddf2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:35.055890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7c26f58e-fcec-43eb-a4aa-93df6450ddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:35.221906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f58e-fcec-43eb-a4aa-93df6450ddf2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:35.264572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:35.354536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dcc29-6638-44b4-b909-46b46e06df04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:35.355078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dcc29-6638-44b4-b909-46b46e06df04 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:35.355385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dcc29-6638-44b4-b909-46b46e06df04 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:35.355663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dcc29-6638-44b4-b909-46b46e06df04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:35.357302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc1dcc29-6638-44b4-b909-46b46e06df04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:35.451472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dcc29-6638-44b4-b909-46b46e06df04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:35.453222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dcc29-6638-44b4-b909-46b46e06df04 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:35.473521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 697/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:37.733104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341dadc-8ffb-4cdf-836d-f9d32a475c56 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:37.733663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341dadc-8ffb-4cdf-836d-f9d32a475c56 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:37.733663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341dadc-8ffb-4cdf-836d-f9d32a475c56 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:37.739736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 710/1407] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:37.741461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0712c8-9d71-4404-ae2c-3a289c975855 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:37.741945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0712c8-9d71-4404-ae2c-3a289c975855 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:37.742142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0712c8-9d71-4404-ae2c-3a289c975855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:37.796893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:37.817214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a0712c8-9d71-4404-ae2c-3a289c975855 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:37.818544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a0712c8-9d71-4404-ae2c-3a289c975855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:37.931996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 698/1408] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:37.979614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341dadc-8ffb-4cdf-836d-f9d32a475c56 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:37.981196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6341dadc-8ffb-4cdf-836d-f9d32a475c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:38.090625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:38.147907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341dadc-8ffb-4cdf-836d-f9d32a475c56 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:38.269834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d6cde-c1c1-4206-90b5-152fcee69146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:38.270557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6cde-c1c1-4206-90b5-152fcee69146 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:38.270864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6cde-c1c1-4206-90b5-152fcee69146 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:38.271143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6cde-c1c1-4206-90b5-152fcee69146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:38.272772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e94d6cde-c1c1-4206-90b5-152fcee69146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:38.354846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:38.378021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d6cde-c1c1-4206-90b5-152fcee69146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:38.379898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d6cde-c1c1-4206-90b5-152fcee69146 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:38.400124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 711/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:15:47.930014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=47 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:48.397871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=16 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:56.006063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06481f4-3c15-4c80-aca4-8e97c83f96f5 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:56.006678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06481f4-3c15-4c80-aca4-8e97c83f96f5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:56.006780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06481f4-3c15-4c80-aca4-8e97c83f96f5 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:56.008173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 699/1410] 10.222.0.71 () {54 vars in 918 bytes} [Tue Aug 2 09:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:56.013507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2f2f-b571-410c-ad69-a4946e53e61c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:56.013972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2f2f-b571-410c-ad69-a4946e53e61c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:56.014139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2f2f-b571-410c-ad69-a4946e53e61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:56.091246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c7ea2f2f-b571-410c-ad69-a4946e53e61c None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:56.092473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c7ea2f2f-b571-410c-ad69-a4946e53e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:56.198083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 712/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Tue Aug 2 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:15:56.212618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced93c2-049b-4912-acb6-447bb21026fb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:56.212901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced93c2-049b-4912-acb6-447bb21026fb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:56.213177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced93c2-049b-4912-acb6-447bb21026fb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:56.214543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 700/1412] 10.222.0.71 () {54 vars in 918 bytes} [Tue Aug 2 09:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:56.219093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bfb5c-0487-4979-bcee-dea026655181 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:56.219376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bfb5c-0487-4979-bcee-dea026655181 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:56.219649 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bfb5c-0487-4979-bcee-dea026655181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:56.293948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:56.296668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6e0bfb5c-0487-4979-bcee-dea026655181 None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:56.297920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6e0bfb5c-0487-4979-bcee-dea026655181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:56.414168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 713/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Tue Aug 2 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:58.940824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d10b-3b25-45ae-9ab9-d8e01cd40511 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:58.941358 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d10b-3b25-45ae-9ab9-d8e01cd40511 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:58.941571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d10b-3b25-45ae-9ab9-d8e01cd40511 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:58.943211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:15:58.948388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e867b80-4e45-4381-8697-61c1eb82f89f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:58.948793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e867b80-4e45-4381-8697-61c1eb82f89f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:58.948942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e867b80-4e45-4381-8697-61c1eb82f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:59.013777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4e867b80-4e45-4381-8697-61c1eb82f89f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:15:59.014982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4e867b80-4e45-4381-8697-61c1eb82f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:59.071339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:59.112441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:15:59.155082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d10b-3b25-45ae-9ab9-d8e01cd40511 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:15:59.156764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bef8d10b-3b25-45ae-9ab9-d8e01cd40511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:59.303532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d10b-3b25-45ae-9ab9-d8e01cd40511 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:15:59.374909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:59.422147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b064f29-25f7-4075-b2cb-c7528d1a01a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:15:59.422758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b064f29-25f7-4075-b2cb-c7528d1a01a0 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:15:59.423036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b064f29-25f7-4075-b2cb-c7528d1a01a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:15:59.423307 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b064f29-25f7-4075-b2cb-c7528d1a01a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:15:59.424909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5b064f29-25f7-4075-b2cb-c7528d1a01a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:15:59.514200 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b064f29-25f7-4075-b2cb-c7528d1a01a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:15:59.515813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b064f29-25f7-4075-b2cb-c7528d1a01a0 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:15:59.534294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 702/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:00.439131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58385-e9c3-4220-8416-22f638e1ca21 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:00.439638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58385-e9c3-4220-8416-22f638e1ca21 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:00.439746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c58385-e9c3-4220-8416-22f638e1ca21 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:00.441083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:00.446216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc54d7-07d6-4924-b55d-d60e65151c83 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:00.446676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc54d7-07d6-4924-b55d-d60e65151c83 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:00.446787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc54d7-07d6-4924-b55d-d60e65151c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:00.523147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-acbc54d7-07d6-4924-b55d-d60e65151c83 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:00.524363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-acbc54d7-07d6-4924-b55d-d60e65151c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:00.552920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:00.627493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:00.779933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58385-e9c3-4220-8416-22f638e1ca21 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:00.781449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-24c58385-e9c3-4220-8416-22f638e1ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:00.928152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c58385-e9c3-4220-8416-22f638e1ca21 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:00.967885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:01.042202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2983d-6795-4b15-950c-5b9022d3898c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:01.042727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2983d-6795-4b15-950c-5b9022d3898c service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:01.043004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2983d-6795-4b15-950c-5b9022d3898c service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:01.043272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2983d-6795-4b15-950c-5b9022d3898c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:01.044875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a8a2983d-6795-4b15-950c-5b9022d3898c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:01.132753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2983d-6795-4b15-950c-5b9022d3898c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:01.134390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2983d-6795-4b15-950c-5b9022d3898c service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:01.152225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 716/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:02.038516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95def27d-411f-45fa-833a-9a21d728eea2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:02.039105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95def27d-411f-45fa-833a-9a21d728eea2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:02.039105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95def27d-411f-45fa-833a-9a21d728eea2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:02.040482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:02.045397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbc7c9-dfaf-4cd5-a30f-b0d91b82c01b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:02.045877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbc7c9-dfaf-4cd5-a30f-b0d91b82c01b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:02.045982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbc7c9-dfaf-4cd5-a30f-b0d91b82c01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:02.100644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:02.122668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-61fbc7c9-dfaf-4cd5-a30f-b0d91b82c01b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:02.123792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-61fbc7c9-dfaf-4cd5-a30f-b0d91b82c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:02.218374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:02.371442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95def27d-411f-45fa-833a-9a21d728eea2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:02.373027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-95def27d-411f-45fa-833a-9a21d728eea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:02.519030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95def27d-411f-45fa-833a-9a21d728eea2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:02.531910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:02.635155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b46a1a-dcf5-484a-bb98-f683bd62661b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:02.635693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b46a1a-dcf5-484a-bb98-f683bd62661b service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:02.635976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b46a1a-dcf5-484a-bb98-f683bd62661b service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:02.636268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b46a1a-dcf5-484a-bb98-f683bd62661b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:02.637930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a0b46a1a-dcf5-484a-bb98-f683bd62661b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:02.726596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b46a1a-dcf5-484a-bb98-f683bd62661b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:02.728220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b46a1a-dcf5-484a-bb98-f683bd62661b service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:02.746900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 705/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:03.609140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d113a01-9e84-49d3-ba37-6916cef24b8b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:03.609683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d113a01-9e84-49d3-ba37-6916cef24b8b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:03.609683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d113a01-9e84-49d3-ba37-6916cef24b8b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:03.611097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:03.616679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4650fec-799e-4fe3-a7db-5028bca0aa86 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:03.617130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4650fec-799e-4fe3-a7db-5028bca0aa86 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:03.617283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4650fec-799e-4fe3-a7db-5028bca0aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:03.637083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:03.693846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c4650fec-799e-4fe3-a7db-5028bca0aa86 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:03.695064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c4650fec-799e-4fe3-a7db-5028bca0aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:03.790964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:03.949060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d113a01-9e84-49d3-ba37-6916cef24b8b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:03.950627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1d113a01-9e84-49d3-ba37-6916cef24b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:04.063562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:04.100017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d113a01-9e84-49d3-ba37-6916cef24b8b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:04.212605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77907b-8809-46a9-92c1-39a7ee4af102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:04.213213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77907b-8809-46a9-92c1-39a7ee4af102 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:04.213487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77907b-8809-46a9-92c1-39a7ee4af102 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:04.213787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77907b-8809-46a9-92c1-39a7ee4af102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:04.215376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9c77907b-8809-46a9-92c1-39a7ee4af102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:04.293136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:04.307452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77907b-8809-46a9-92c1-39a7ee4af102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:04.309072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77907b-8809-46a9-92c1-39a7ee4af102 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:04.327472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 719/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:05.188198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097400b-bf57-45aa-a297-dda36e3e6764 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:05.188723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097400b-bf57-45aa-a297-dda36e3e6764 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:05.188834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097400b-bf57-45aa-a297-dda36e3e6764 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:05.190201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:05.195093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8815dc-d8c3-480a-bf09-c1e28b880cc7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:05.195524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8815dc-d8c3-480a-bf09-c1e28b880cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:05.195645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8815dc-d8c3-480a-bf09-c1e28b880cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:05.270502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-eb8815dc-d8c3-480a-bf09-c1e28b880cc7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:05.271739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eb8815dc-d8c3-480a-bf09-c1e28b880cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:05.369397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:05.523023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097400b-bf57-45aa-a297-dda36e3e6764 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:05.524542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1097400b-bf57-45aa-a297-dda36e3e6764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:05.617997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:05.682910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097400b-bf57-45aa-a297-dda36e3e6764 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:05.921530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbbdb6-995a-4964-b0b5-3df97f0bf72d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:05.922183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbbdb6-995a-4964-b0b5-3df97f0bf72d service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:05.922461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbbdb6-995a-4964-b0b5-3df97f0bf72d service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:05.922733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbbdb6-995a-4964-b0b5-3df97f0bf72d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:05.924421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0fcbbdb6-995a-4964-b0b5-3df97f0bf72d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:05.973684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:06.015136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbbdb6-995a-4964-b0b5-3df97f0bf72d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:06.016733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbbdb6-995a-4964-b0b5-3df97f0bf72d service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:06.036285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 708/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:06.915551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049e22-b0ad-43f7-9384-8afa63fed38e None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:06.916075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049e22-b0ad-43f7-9384-8afa63fed38e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:06.916182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049e22-b0ad-43f7-9384-8afa63fed38e None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:06.917499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:06.922500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648edb48-541c-4bd1-b464-079c8bfc815a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:06.922899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648edb48-541c-4bd1-b464-079c8bfc815a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:06.923064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648edb48-541c-4bd1-b464-079c8bfc815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:06.998939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-648edb48-541c-4bd1-b464-079c8bfc815a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:07.000160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-648edb48-541c-4bd1-b464-079c8bfc815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:07.096708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:07.247229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82049e22-b0ad-43f7-9384-8afa63fed38e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:07.248732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-82049e22-b0ad-43f7-9384-8afa63fed38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:07.297973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:07.395218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82049e22-b0ad-43f7-9384-8afa63fed38e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:07.511530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ab51e-0f55-4a70-b396-3433582441e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:07.512136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ab51e-0f55-4a70-b396-3433582441e8 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:07.512412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ab51e-0f55-4a70-b396-3433582441e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:07.512680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ab51e-0f55-4a70-b396-3433582441e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:07.514296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f08ab51e-0f55-4a70-b396-3433582441e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:07.521415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:07.603999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ab51e-0f55-4a70-b396-3433582441e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:07.605569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ab51e-0f55-4a70-b396-3433582441e8 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:07.624896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 722/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:08.492354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39548-a89c-423d-92b2-9b443bfef18d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:08.492903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39548-a89c-423d-92b2-9b443bfef18d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:08.492903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39548-a89c-423d-92b2-9b443bfef18d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:08.494320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:08.499476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34674f-db07-4605-b729-c003613392df None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:08.499901 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34674f-db07-4605-b729-c003613392df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:08.500018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34674f-db07-4605-b729-c003613392df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:08.574336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4b34674f-db07-4605-b729-c003613392df None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:08.575535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4b34674f-db07-4605-b729-c003613392df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:08.641431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:08.670094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:08.822676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39548-a89c-423d-92b2-9b443bfef18d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:08.824201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-01d39548-a89c-423d-92b2-9b443bfef18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:08.842742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:08.971408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39548-a89c-423d-92b2-9b443bfef18d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:09.056884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:09.084646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b1a2-59aa-47df-80a6-bb94d8fb696c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:09.085578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b1a2-59aa-47df-80a6-bb94d8fb696c service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:09.086096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b1a2-59aa-47df-80a6-bb94d8fb696c service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:09.086652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b1a2-59aa-47df-80a6-bb94d8fb696c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:09.088311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-98d2b1a2-59aa-47df-80a6-bb94d8fb696c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:09.177287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b1a2-59aa-47df-80a6-bb94d8fb696c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:09.178938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b1a2-59aa-47df-80a6-bb94d8fb696c service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:09.197439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 711/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:10.070071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36fa7-32b5-42bc-a493-3de27e7dfc34 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:10.070612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36fa7-32b5-42bc-a493-3de27e7dfc34 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:10.070612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36fa7-32b5-42bc-a493-3de27e7dfc34 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:10.071887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:10.076850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0e06-e8af-4e44-bbf9-a3f8c6143ef6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:10.077286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0e06-e8af-4e44-bbf9-a3f8c6143ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:10.077433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0e06-e8af-4e44-bbf9-a3f8c6143ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:10.159837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0b2e0e06-e8af-4e44-bbf9-a3f8c6143ef6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:10.161337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0b2e0e06-e8af-4e44-bbf9-a3f8c6143ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:10.202199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:10.256926 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:10.410175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c36fa7-32b5-42bc-a493-3de27e7dfc34 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:10.412352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f4c36fa7-32b5-42bc-a493-3de27e7dfc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:10.557274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c36fa7-32b5-42bc-a493-3de27e7dfc34 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:10.609909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:10.672416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c819214-8378-4d49-83d6-1a25804553bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:10.673080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819214-8378-4d49-83d6-1a25804553bf service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:10.673356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819214-8378-4d49-83d6-1a25804553bf service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:10.673627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819214-8378-4d49-83d6-1a25804553bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:10.675340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5c819214-8378-4d49-83d6-1a25804553bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:10.771573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c819214-8378-4d49-83d6-1a25804553bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:10.773162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c819214-8378-4d49-83d6-1a25804553bf service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:10.792357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 725/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:11.664957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31b83-c914-46e4-93ff-71c0bacaf5fd None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:11.665495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31b83-c914-46e4-93ff-71c0bacaf5fd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:11.665495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31b83-c914-46e4-93ff-71c0bacaf5fd None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:11.666811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:11.671581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777cc14-7eff-4579-97d1-48394ce24d8c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:11.672004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777cc14-7eff-4579-97d1-48394ce24d8c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:11.672139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777cc14-7eff-4579-97d1-48394ce24d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:11.748266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8777cc14-7eff-4579-97d1-48394ce24d8c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:11.749501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8777cc14-7eff-4579-97d1-48394ce24d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:11.751582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:11.846845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:11.999481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b31b83-c914-46e4-93ff-71c0bacaf5fd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:12.000991 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-01b31b83-c914-46e4-93ff-71c0bacaf5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:12.151861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b31b83-c914-46e4-93ff-71c0bacaf5fd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:12.179507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:12.265457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cbea-d08b-42fd-be7d-6cc5b9bdeed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:12.266016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cbea-d08b-42fd-be7d-6cc5b9bdeed2 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:12.266295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cbea-d08b-42fd-be7d-6cc5b9bdeed2 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:12.266577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cbea-d08b-42fd-be7d-6cc5b9bdeed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:12.268164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60d5cbea-d08b-42fd-be7d-6cc5b9bdeed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:12.356376 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5cbea-d08b-42fd-be7d-6cc5b9bdeed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:12.357989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5cbea-d08b-42fd-be7d-6cc5b9bdeed2 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:12.375967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 714/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:14.286216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b7c26-d2fd-443d-8361-f9e4c8aa635b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.286757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b7c26-d2fd-443d-8361-f9e4c8aa635b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.286757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b7c26-d2fd-443d-8361-f9e4c8aa635b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.288229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:14.293735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e2f9-e551-4a2f-8c2f-ee27c88a5812 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.294150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e2f9-e551-4a2f-8c2f-ee27c88a5812 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.294319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e2f9-e551-4a2f-8c2f-ee27c88a5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.335026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:14.359355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9c24e2f9-e551-4a2f-8c2f-ee27c88a5812 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:14.360565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9c24e2f9-e551-4a2f-8c2f-ee27c88a5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:14.462472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:14.501070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b7c26-d2fd-443d-8361-f9e4c8aa635b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:14.502681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ef5b7c26-d2fd-443d-8361-f9e4c8aa635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:14.605876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b7c26-d2fd-443d-8361-f9e4c8aa635b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:14.638169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:14.680359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57415dcd-3d5f-4d61-86ac-790c82a30832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:14.680962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415dcd-3d5f-4d61-86ac-790c82a30832 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:14.681240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415dcd-3d5f-4d61-86ac-790c82a30832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:14.681509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415dcd-3d5f-4d61-86ac-790c82a30832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:14.683142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-57415dcd-3d5f-4d61-86ac-790c82a30832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:14.793425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57415dcd-3d5f-4d61-86ac-790c82a30832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:14.794900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57415dcd-3d5f-4d61-86ac-790c82a30832 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:14.813340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 728/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:17.005239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354718e-f299-4862-8bb7-7241158ba97d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:17.005830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354718e-f299-4862-8bb7-7241158ba97d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:17.005830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354718e-f299-4862-8bb7-7241158ba97d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:17.007209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:17.012680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc46cca-6dc2-4062-9b80-505192bd8c72 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:17.013921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc46cca-6dc2-4062-9b80-505192bd8c72 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:17.013921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc46cca-6dc2-4062-9b80-505192bd8c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:17.079972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ccc46cca-6dc2-4062-9b80-505192bd8c72 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:17.081219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ccc46cca-6dc2-4062-9b80-505192bd8c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:17.094765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:17.178199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:17.217463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354718e-f299-4862-8bb7-7241158ba97d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:17.219054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c354718e-f299-4862-8bb7-7241158ba97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:17.322419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354718e-f299-4862-8bb7-7241158ba97d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:17.335893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:17.398217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a5856-8033-49a4-9003-7eed46f745aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:17.398883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5856-8033-49a4-9003-7eed46f745aa service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:17.399163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5856-8033-49a4-9003-7eed46f745aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:17.399435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5856-8033-49a4-9003-7eed46f745aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:17.401047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-802a5856-8033-49a4-9003-7eed46f745aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:17.509764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a5856-8033-49a4-9003-7eed46f745aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:17.511128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a5856-8033-49a4-9003-7eed46f745aa service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:17.528561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 717/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:19.941102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426870-b057-4c6e-a765-9080b387b0dd None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:19.941800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426870-b057-4c6e-a765-9080b387b0dd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:19.941800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426870-b057-4c6e-a765-9080b387b0dd None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:19.943093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:19.948292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73f3b-0505-4d60-81f2-4230e27f0c0d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:19.948688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73f3b-0505-4d60-81f2-4230e27f0c0d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:19.948894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73f3b-0505-4d60-81f2-4230e27f0c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:19.997433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:20.014951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0be73f3b-0505-4d60-81f2-4230e27f0c0d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:20.016187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0be73f3b-0505-4d60-81f2-4230e27f0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:20.112571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:20.151433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40426870-b057-4c6e-a765-9080b387b0dd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:20.153004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-40426870-b057-4c6e-a765-9080b387b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:20.255213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40426870-b057-4c6e-a765-9080b387b0dd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:20.294472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:20.327706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a73f0-7968-4d87-b7a5-b44030795750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:20.328315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a73f0-7968-4d87-b7a5-b44030795750 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:20.328597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a73f0-7968-4d87-b7a5-b44030795750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:20.328872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a73f0-7968-4d87-b7a5-b44030795750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:20.330507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4d1a73f0-7968-4d87-b7a5-b44030795750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:20.441369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a73f0-7968-4d87-b7a5-b44030795750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:20.442872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a73f0-7968-4d87-b7a5-b44030795750 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:20.461575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 731/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:22.593914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31adce-6e43-43ea-8f22-12b65d860bd6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:22.594471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31adce-6e43-43ea-8f22-12b65d860bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:22.594471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31adce-6e43-43ea-8f22-12b65d860bd6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:22.595876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:22.601746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c196-11ee-4056-b1a0-adbd74a28de0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:22.602155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c196-11ee-4056-b1a0-adbd74a28de0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:22.602319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c196-11ee-4056-b1a0-adbd74a28de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:22.668581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-99f2c196-11ee-4056-b1a0-adbd74a28de0 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:22.669752 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-99f2c196-11ee-4056-b1a0-adbd74a28de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:22.690634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:22.766551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:22.808228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31adce-6e43-43ea-8f22-12b65d860bd6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:22.809807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6b31adce-6e43-43ea-8f22-12b65d860bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:22.914416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31adce-6e43-43ea-8f22-12b65d860bd6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:22.934279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:22.987873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cff153-d9d3-49e3-9841-024ec7c6c241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:22.988613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff153-d9d3-49e3-9841-024ec7c6c241 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:22.989241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff153-d9d3-49e3-9841-024ec7c6c241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:22.989513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff153-d9d3-49e3-9841-024ec7c6c241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:22.991260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-23cff153-d9d3-49e3-9841-024ec7c6c241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:23.100399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cff153-d9d3-49e3-9841-024ec7c6c241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:23.101864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cff153-d9d3-49e3-9841-024ec7c6c241 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:23.119836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 720/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:25.184562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93f596-5456-4382-9eec-f5b847da9940 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:25.185161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93f596-5456-4382-9eec-f5b847da9940 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:25.185161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93f596-5456-4382-9eec-f5b847da9940 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:25.186631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:25.192155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aff99-6942-45ee-aea5-1abc5b9482d5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:25.193283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aff99-6942-45ee-aea5-1abc5b9482d5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:25.193283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aff99-6942-45ee-aea5-1abc5b9482d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:25.256320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:25.258911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a5aff99-6942-45ee-aea5-1abc5b9482d5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:25.260126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a5aff99-6942-45ee-aea5-1abc5b9482d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:25.355706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:25.394130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93f596-5456-4382-9eec-f5b847da9940 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:25.396270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3a93f596-5456-4382-9eec-f5b847da9940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:25.500183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93f596-5456-4382-9eec-f5b847da9940 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:25.548033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:25.572715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9f70d-9da7-4e2e-856b-368399b39bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:25.573326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f70d-9da7-4e2e-856b-368399b39bec service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:25.573610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f70d-9da7-4e2e-856b-368399b39bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:25.573924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f70d-9da7-4e2e-856b-368399b39bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:25.575535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-afd9f70d-9da7-4e2e-856b-368399b39bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:25.683047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f70d-9da7-4e2e-856b-368399b39bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:25.684493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f70d-9da7-4e2e-856b-368399b39bec service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:25.704192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 734/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:27.782130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600edc0-b49d-4852-afda-37f11c50ba3f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:27.782679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600edc0-b49d-4852-afda-37f11c50ba3f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:27.782679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600edc0-b49d-4852-afda-37f11c50ba3f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:27.784101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:27.789432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e836-2849-42d7-8e7d-d5d2da672bf2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:27.789888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e836-2849-42d7-8e7d-d5d2da672bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:27.790050 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e836-2849-42d7-8e7d-d5d2da672bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:27.856231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9582e836-2849-42d7-8e7d-d5d2da672bf2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:27.857441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9582e836-2849-42d7-8e7d-d5d2da672bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:27.889272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:27.956520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:27.995241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600edc0-b49d-4852-afda-37f11c50ba3f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:27.996821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0600edc0-b49d-4852-afda-37f11c50ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:28.100712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600edc0-b49d-4852-afda-37f11c50ba3f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:28.128678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:28.173291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7580e76-d4cd-4adf-84dd-8a9f91561767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:28.173936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7580e76-d4cd-4adf-84dd-8a9f91561767 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:28.174216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7580e76-d4cd-4adf-84dd-8a9f91561767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:28.174492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7580e76-d4cd-4adf-84dd-8a9f91561767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:28.176649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b7580e76-d4cd-4adf-84dd-8a9f91561767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:28.290047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7580e76-d4cd-4adf-84dd-8a9f91561767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:28.291489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7580e76-d4cd-4adf-84dd-8a9f91561767 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:28.311571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 723/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:30.383542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc0cc3-1a13-4e31-9d30-14bd683907c6 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:30.384084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc0cc3-1a13-4e31-9d30-14bd683907c6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:30.384203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc0cc3-1a13-4e31-9d30-14bd683907c6 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:30.385508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:30.390777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373e64-1c4e-430b-9c78-4c621979856d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:30.391209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373e64-1c4e-430b-9c78-4c621979856d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:30.391330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373e64-1c4e-430b-9c78-4c621979856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:30.458015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-18373e64-1c4e-430b-9c78-4c621979856d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:30.459230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18373e64-1c4e-430b-9c78-4c621979856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:30.467501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:30.557038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:30.594662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc0cc3-1a13-4e31-9d30-14bd683907c6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:30.596187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-27bc0cc3-1a13-4e31-9d30-14bd683907c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:30.698958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc0cc3-1a13-4e31-9d30-14bd683907c6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:30.753970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:30.773547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af02de-0b3f-4ed0-a66f-6b4ae3065bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:30.774189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af02de-0b3f-4ed0-a66f-6b4ae3065bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:30.774468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af02de-0b3f-4ed0-a66f-6b4ae3065bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:30.774738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af02de-0b3f-4ed0-a66f-6b4ae3065bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:30.776375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d0af02de-0b3f-4ed0-a66f-6b4ae3065bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:30.885680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af02de-0b3f-4ed0-a66f-6b4ae3065bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:30.887367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af02de-0b3f-4ed0-a66f-6b4ae3065bc7 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:30.905864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 737/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:33.006794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1845fd8-0e76-47ba-9919-0b78a7a47b04 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:33.007356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1845fd8-0e76-47ba-9919-0b78a7a47b04 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:33.007356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1845fd8-0e76-47ba-9919-0b78a7a47b04 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:33.008698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:33.014233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026a6d-8dbb-4269-892c-f3ff6abaa2a8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:33.014651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026a6d-8dbb-4269-892c-f3ff6abaa2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:33.014772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026a6d-8dbb-4269-892c-f3ff6abaa2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:33.081440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-06026a6d-8dbb-4269-892c-f3ff6abaa2a8 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:33.083775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-06026a6d-8dbb-4269-892c-f3ff6abaa2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:33.122053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:33.180980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:33.218090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1845fd8-0e76-47ba-9919-0b78a7a47b04 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:33.219656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a1845fd8-0e76-47ba-9919-0b78a7a47b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:33.324331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1845fd8-0e76-47ba-9919-0b78a7a47b04 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:33.362665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:33.398866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150340-bf57-48dd-913f-4222bfb89410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:33.399527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150340-bf57-48dd-913f-4222bfb89410 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:33.400129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150340-bf57-48dd-913f-4222bfb89410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:33.400410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150340-bf57-48dd-913f-4222bfb89410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:33.402074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b6150340-bf57-48dd-913f-4222bfb89410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:33.508436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150340-bf57-48dd-913f-4222bfb89410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:33.509905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150340-bf57-48dd-913f-4222bfb89410 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:33.528683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 726/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:35.542627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196d86-23ef-46ee-9e98-559befa174a8 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:35.543185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196d86-23ef-46ee-9e98-559befa174a8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:35.543300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196d86-23ef-46ee-9e98-559befa174a8 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:35.544653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:35.550098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdb522-8f55-4dc2-832e-d2be3d4f9063 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:35.550681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdb522-8f55-4dc2-832e-d2be3d4f9063 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:35.550785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdb522-8f55-4dc2-832e-d2be3d4f9063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:35.619082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e4cdb522-8f55-4dc2-832e-d2be3d4f9063 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:35.620458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e4cdb522-8f55-4dc2-832e-d2be3d4f9063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:35.638231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:35.716105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:35.753189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4196d86-23ef-46ee-9e98-559befa174a8 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:35.754956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b4196d86-23ef-46ee-9e98-559befa174a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:35.857997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4196d86-23ef-46ee-9e98-559befa174a8 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:35.925908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:35.932887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ba3b0-be0f-47a5-9e5c-7f8384011de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:35.933505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba3b0-be0f-47a5-9e5c-7f8384011de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:35.933827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba3b0-be0f-47a5-9e5c-7f8384011de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:35.934105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba3b0-be0f-47a5-9e5c-7f8384011de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:35.935793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3f4ba3b0-be0f-47a5-9e5c-7f8384011de4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:36.046913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ba3b0-be0f-47a5-9e5c-7f8384011de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:36.048357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ba3b0-be0f-47a5-9e5c-7f8384011de4 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:36.067709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 740/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:38.121690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a16d-84c2-4dfd-a5c0-d3af750bde37 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:38.122303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a16d-84c2-4dfd-a5c0-d3af750bde37 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:38.122303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a16d-84c2-4dfd-a5c0-d3af750bde37 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:38.123550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:38.129501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7c6f-43a1-4193-9b7d-422cf113a9d4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:38.129962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7c6f-43a1-4193-9b7d-422cf113a9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:38.130115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7c6f-43a1-4193-9b7d-422cf113a9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:38.196236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b49e7c6f-43a1-4193-9b7d-422cf113a9d4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:38.197449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b49e7c6f-43a1-4193-9b7d-422cf113a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:38.247113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:38.295316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:38.332409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a16d-84c2-4dfd-a5c0-d3af750bde37 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:38.333700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c059a16d-84c2-4dfd-a5c0-d3af750bde37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:38.436835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a16d-84c2-4dfd-a5c0-d3af750bde37 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:38.483639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:38.509520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4b5bc-f1de-4a07-8bce-8ea3b6eaa36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:38.510168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4b5bc-f1de-4a07-8bce-8ea3b6eaa36c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:38.510452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4b5bc-f1de-4a07-8bce-8ea3b6eaa36c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:38.510731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4b5bc-f1de-4a07-8bce-8ea3b6eaa36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:38.513075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4fe4b5bc-f1de-4a07-8bce-8ea3b6eaa36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:38.620414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4b5bc-f1de-4a07-8bce-8ea3b6eaa36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:38.621894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4b5bc-f1de-4a07-8bce-8ea3b6eaa36c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:38.640166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 729/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:16:48.293476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=22 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:48.637950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=66 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:59.090911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77ce7-9060-470e-89a0-958e1b406e09 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:59.091506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77ce7-9060-470e-89a0-958e1b406e09 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:59.091506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77ce7-9060-470e-89a0-958e1b406e09 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:59.092860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 742/1471] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:59.098448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdefaf-dce3-428a-a4fc-3d93675b328b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:59.098891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdefaf-dce3-428a-a4fc-3d93675b328b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:59.098994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdefaf-dce3-428a-a4fc-3d93675b328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:59.182148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8dbdefaf-dce3-428a-a4fc-3d93675b328b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:59.183390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8dbdefaf-dce3-428a-a4fc-3d93675b328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:59.295361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 730/1472] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:59.386201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eb0d5-2679-455f-86fd-7f267941146a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:59.386484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eb0d5-2679-455f-86fd-7f267941146a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:59.386758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eb0d5-2679-455f-86fd-7f267941146a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:59.388105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 743/1473] 10.222.0.71 () {54 vars in 966 bytes} [Tue Aug 2 09:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:16:59.393142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9460d-556c-4aea-8887-8b8386a30dc3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:59.393433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9460d-556c-4aea-8887-8b8386a30dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:59.393712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9460d-556c-4aea-8887-8b8386a30dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:59.474932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d0b9460d-556c-4aea-8887-8b8386a30dc3 None None] MFA Rules not processed for user `71adb0143db64ca68f9c3846951adb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:16:59.476051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d0b9460d-556c-4aea-8887-8b8386a30dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:59.498345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:59.560181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 731/1474] 10.222.0.71 () {58 vars in 1063 bytes} [Tue Aug 2 09:16:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:16:59.570979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eb0d5-2679-455f-86fd-7f267941146a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:16:59.572620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-606eb0d5-2679-455f-86fd-7f267941146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:59.687562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eb0d5-2679-455f-86fd-7f267941146a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:16:59.769174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b9fa2-e90e-40fc-8feb-e8fdc336d225 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adb0143db64ca68f9c3846951adb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:16:59.769811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b9fa2-e90e-40fc-8feb-e8fdc336d225 service glance] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:16:59.770098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b9fa2-e90e-40fc-8feb-e8fdc336d225 service glance] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:16:59.770378 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b9fa2-e90e-40fc-8feb-e8fdc336d225 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:16:59.772009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-339b9fa2-e90e-40fc-8feb-e8fdc336d225 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:16:59.827258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:59.883765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b9fa2-e90e-40fc-8feb-e8fdc336d225 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:16:59.885211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b9fa2-e90e-40fc-8feb-e8fdc336d225 service glance] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:16:59.904271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 744/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:02.039074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fb35-d2b2-4a4e-ac13-fab9bb9800c3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.039653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fb35-d2b2-4a4e-ac13-fab9bb9800c3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.039653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fb35-d2b2-4a4e-ac13-fab9bb9800c3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.041026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 732/1476] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:02.046324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327eb4-2e91-416d-8290-252cb9bff32d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.046749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327eb4-2e91-416d-8290-252cb9bff32d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.046869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327eb4-2e91-416d-8290-252cb9bff32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.112336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-54327eb4-2e91-416d-8290-252cb9bff32d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:02.114223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-54327eb4-2e91-416d-8290-252cb9bff32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:02.216964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 745/1477] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:02.241286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fb35-d2b2-4a4e-ac13-fab9bb9800c3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:02.242879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-32b2fb35-d2b2-4a4e-ac13-fab9bb9800c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:02.368602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fb35-d2b2-4a4e-ac13-fab9bb9800c3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:02.417218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:02.462466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5409-fa7b-46d6-a178-9feea1cfb43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:02.463083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5409-fa7b-46d6-a178-9feea1cfb43d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:02.463361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5409-fa7b-46d6-a178-9feea1cfb43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:02.463635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5409-fa7b-46d6-a178-9feea1cfb43d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:02.464327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5409-fa7b-46d6-a178-9feea1cfb43d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:02.466084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-0fde5409-fa7b-46d6-a178-9feea1cfb43d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:17:02.466084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:17:02.466084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:17:02.467276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5409-fa7b-46d6-a178-9feea1cfb43d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:02.487355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 733/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Tue Aug 2 09:17:02 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:17:04.530478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d9d6-27f0-48f1-bada-6cf7527e5e71 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:04.531026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d9d6-27f0-48f1-bada-6cf7527e5e71 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:04.531026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d9d6-27f0-48f1-bada-6cf7527e5e71 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:04.532373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 746/1479] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:04.538286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a9782-d288-42cd-9a9a-fb3363480189 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:04.538735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a9782-d288-42cd-9a9a-fb3363480189 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:04.538839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a9782-d288-42cd-9a9a-fb3363480189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:04.604193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-486a9782-d288-42cd-9a9a-fb3363480189 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:04.605423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-486a9782-d288-42cd-9a9a-fb3363480189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:04.700323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 734/1480] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:04.743817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d9d6-27f0-48f1-bada-6cf7527e5e71 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:04.745319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e358d9d6-27f0-48f1-bada-6cf7527e5e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:04.755586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:04.897111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d9d6-27f0-48f1-bada-6cf7527e5e71 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:04.977923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:05.010647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f19724-76f6-41bc-a8b8-2472d90bb4e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:05.011257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19724-76f6-41bc-a8b8-2472d90bb4e0 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:05.011537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19724-76f6-41bc-a8b8-2472d90bb4e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:05.011811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19724-76f6-41bc-a8b8-2472d90bb4e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:05.013410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d0f19724-76f6-41bc-a8b8-2472d90bb4e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:05.105242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f19724-76f6-41bc-a8b8-2472d90bb4e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:05.106876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f19724-76f6-41bc-a8b8-2472d90bb4e0 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:05.125668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 747/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:07.339189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03ff4-5733-457e-86cd-133b2f04f747 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:07.339767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03ff4-5733-457e-86cd-133b2f04f747 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:07.339767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03ff4-5733-457e-86cd-133b2f04f747 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:07.341208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 735/1482] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:07.346641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304771c-9083-41bf-bf52-d769fcb61958 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:07.347961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304771c-9083-41bf-bf52-d769fcb61958 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:07.348274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304771c-9083-41bf-bf52-d769fcb61958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:07.417427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0304771c-9083-41bf-bf52-d769fcb61958 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:07.418599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0304771c-9083-41bf-bf52-d769fcb61958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:07.465464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:07.519372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 748/1483] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:07.558420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e03ff4-5733-457e-86cd-133b2f04f747 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:07.559957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a7e03ff4-5733-457e-86cd-133b2f04f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:07.584082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:07.664398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e03ff4-5733-457e-86cd-133b2f04f747 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:07.740746 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbaf79-852f-4fab-923e-39de8098765d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:07.741431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbaf79-852f-4fab-923e-39de8098765d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:07.741710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbaf79-852f-4fab-923e-39de8098765d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:07.742074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbaf79-852f-4fab-923e-39de8098765d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:07.743684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d7cbaf79-852f-4fab-923e-39de8098765d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:07.819458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:07.854714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbaf79-852f-4fab-923e-39de8098765d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:07.856150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbaf79-852f-4fab-923e-39de8098765d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:07.875318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 736/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:09.941599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5732f-4248-4851-92a2-9558797739a0 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:09.946292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5732f-4248-4851-92a2-9558797739a0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:09.946292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5732f-4248-4851-92a2-9558797739a0 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:09.946292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 749/1485] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:09.948662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb49e-ef3c-474e-a85c-23b6d2bc78c6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:09.949101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb49e-ef3c-474e-a85c-23b6d2bc78c6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:09.949266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb49e-ef3c-474e-a85c-23b6d2bc78c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:10.019918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-452cb49e-ef3c-474e-a85c-23b6d2bc78c6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:10.021127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-452cb49e-ef3c-474e-a85c-23b6d2bc78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:10.116873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 737/1486] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:10.155961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5732f-4248-4851-92a2-9558797739a0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:10.157462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ead5732f-4248-4851-92a2-9558797739a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:10.260088 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5732f-4248-4851-92a2-9558797739a0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:10.330780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:10.333224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83daa71-9ebf-457b-b328-d8d09da26091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:10.333872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83daa71-9ebf-457b-b328-d8d09da26091 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:10.334156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83daa71-9ebf-457b-b328-d8d09da26091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:10.334427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83daa71-9ebf-457b-b328-d8d09da26091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:10.336042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d83daa71-9ebf-457b-b328-d8d09da26091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:10.450149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83daa71-9ebf-457b-b328-d8d09da26091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:10.454903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83daa71-9ebf-457b-b328-d8d09da26091 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:10.469763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 750/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:12.624418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b638f6-ddc4-4482-960f-2cafbdbf177e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:12.624988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b638f6-ddc4-4482-960f-2cafbdbf177e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:12.624988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b638f6-ddc4-4482-960f-2cafbdbf177e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:12.626350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 738/1488] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:12.631935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af938b-951a-4975-aeb3-d7767bfd48e7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:12.632358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af938b-951a-4975-aeb3-d7767bfd48e7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:12.632501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af938b-951a-4975-aeb3-d7767bfd48e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:12.698209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c7af938b-951a-4975-aeb3-d7767bfd48e7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:12.699442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c7af938b-951a-4975-aeb3-d7767bfd48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:12.755015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:12.804861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 751/1489] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:12.845373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b638f6-ddc4-4482-960f-2cafbdbf177e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:12.847725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a7b638f6-ddc4-4482-960f-2cafbdbf177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:12.883734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:12.950244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b638f6-ddc4-4482-960f-2cafbdbf177e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:13.024962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0129b6a-d1d4-4f38-bc74-1f5ed87812c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:13.025576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129b6a-d1d4-4f38-bc74-1f5ed87812c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:13.025899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129b6a-d1d4-4f38-bc74-1f5ed87812c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:13.026208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129b6a-d1d4-4f38-bc74-1f5ed87812c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:13.027828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e0129b6a-d1d4-4f38-bc74-1f5ed87812c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:13.107241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:13.136966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0129b6a-d1d4-4f38-bc74-1f5ed87812c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:13.138445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0129b6a-d1d4-4f38-bc74-1f5ed87812c2 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:13.156790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 739/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:17:15.652462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25888238-7991-4628-947c-9d9b945f0a0a None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:15.653039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25888238-7991-4628-947c-9d9b945f0a0a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:15.653039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25888238-7991-4628-947c-9d9b945f0a0a None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:15.654414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 752/1491] 10.222.0.71 () {54 vars in 926 bytes} [Tue Aug 2 09:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:17:15.659738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7858000-2306-495c-bb05-6e723dee3d0e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:15.660232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7858000-2306-495c-bb05-6e723dee3d0e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:15.660337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7858000-2306-495c-bb05-6e723dee3d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:15.726232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e7858000-2306-495c-bb05-6e723dee3d0e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:17:15.727447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e7858000-2306-495c-bb05-6e723dee3d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:15.825075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 740/1492] 10.222.0.71 () {58 vars in 1023 bytes} [Tue Aug 2 09:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:17:15.865679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25888238-7991-4628-947c-9d9b945f0a0a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:17:15.867245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-25888238-7991-4628-947c-9d9b945f0a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:15.974024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25888238-7991-4628-947c-9d9b945f0a0a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:17:16.046155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab7ea4-d419-4522-b8a9-db8063d604d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:17:16.046766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7ea4-d419-4522-b8a9-db8063d604d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:17:16.047047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7ea4-d419-4522-b8a9-db8063d604d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:17:16.047322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7ea4-d419-4522-b8a9-db8063d604d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:17:16.048933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7fab7ea4-d419-4522-b8a9-db8063d604d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:17:16.058540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:16.157590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7ea4-d419-4522-b8a9-db8063d604d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:17:16.159640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7ea4-d419-4522-b8a9-db8063d604d0 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:17:16.179097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 753/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:17:25.823290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=82 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:26.176679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=50 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:53.173735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:53.174348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:53.174348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:53.250507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:53.251712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:53.349902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 741/1494] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:53.358051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6ba9-c2e1-4c03-ae24-d8eee50af57e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:53.358546 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6ba9-c2e1-4c03-ae24-d8eee50af57e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:53.358654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6ba9-c2e1-4c03-ae24-d8eee50af57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:53.437393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f06a6ba9-c2e1-4c03-ae24-d8eee50af57e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:53.438559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f06a6ba9-c2e1-4c03-ae24-d8eee50af57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:53.534053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 754/1495] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:53.539451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:53.540712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:53.552620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7df5-051e-4ced-97ff-ef994905c9fc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:53.612534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:53.646818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:53.647431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:53.647710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:53.647985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:53.648672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:18:53.648975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:53.650021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:53.650021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:18:53.650021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:18:53.650906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:53.662368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 742/1496] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:18:53.670772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6ba9-c2e1-4c03-ae24-d8eee50af57e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:53.681194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6ba9-c2e1-4c03-ae24-d8eee50af57e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:53.742605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:53.777158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:53.777997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:53.778498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:53.779079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:53.779773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:53.781512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:53.781512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: warnings.warn(msg) Aug 02 09:18:53.781512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: Aug 02 09:18:53.782764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:53.903057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 755/1497] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:18:53 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:53.907414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:53.908954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:53.943739 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651163-4a80-41ec-b095-575279345569 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:54.039877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:54.040417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.040697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.040973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.041626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:54.042674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:54.042674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:18:54.042674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:18:54.043896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.165093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 743/1498] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:18:53 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:18:54.169311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:54.170896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:54.232208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd5108-d1e4-4e35-b237-faeb3bbf01a0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:54.314060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:54.325116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:54.325747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.326045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.326322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.327014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:54.328026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:54.328026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: warnings.warn(msg) Aug 02 09:18:54.328026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: Aug 02 09:18:54.328914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.341990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 756/1499] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:54.345859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:54.347883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:54.359073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95837450-1330-4e14-b235-ba408baf09a4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:54.385045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:54.457258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39dd3-39fa-4168-9415-76cff85f1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:54.458153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39dd3-39fa-4168-9415-76cff85f1f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.458463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39dd3-39fa-4168-9415-76cff85f1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.458745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39dd3-39fa-4168-9415-76cff85f1f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.459441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39dd3-39fa-4168-9415-76cff85f1f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:54.460466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-e4e39dd3-39fa-4168-9415-76cff85f1f08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:54.460466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:18:54.460466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:18:54.461363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39dd3-39fa-4168-9415-76cff85f1f08 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.474590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 744/1500] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:18:54.478789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:54.480306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:54.513701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd68df-790c-472d-a9d0-e8d8f120ba03 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:54.606932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c3c1-ced7-4067-9c20-11c3e783338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:54.607515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c3c1-ced7-4067-9c20-11c3e783338d admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.607796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c3c1-ced7-4067-9c20-11c3e783338d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.608068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c3c1-ced7-4067-9c20-11c3e783338d admin admin] PATH_INFO: `/v3/projects/27e6717788ca4155b97ceeba3897091b/users/757aeddb78f14d699df2c643310dda5a/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.631356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767c3c1-ced7-4067-9c20-11c3e783338d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e6717788ca4155b97ceeba3897091b, user_id=757aeddb78f14d699df2c643310dda5a, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:54.632380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-6767c3c1-ced7-4067-9c20-11c3e783338d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:54.632380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: warnings.warn(msg) Aug 02 09:18:54.632380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: Aug 02 09:18:54.634353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767c3c1-ced7-4067-9c20-11c3e783338d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:54.764843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 757/1501] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:18:54 2022] PUT /identity/v3/projects/27e6717788ca4155b97ceeba3897091b/users/757aeddb78f14d699df2c643310dda5a/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:54.777441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb094-9d85-4be7-afe6-e0cb4143948e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.777756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb094-9d85-4be7-afe6-e0cb4143948e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.778159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb094-9d85-4be7-afe6-e0cb4143948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.841039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1abeb094-9d85-4be7-afe6-e0cb4143948e None None] MFA Rules not processed for user `757aeddb78f14d699df2c643310dda5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:54.842289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1abeb094-9d85-4be7-afe6-e0cb4143948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:54.924084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 745/1502] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:54.937338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2008-a3fc-400c-8cac-ab4d8229a980 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.937640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2008-a3fc-400c-8cac-ab4d8229a980 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.937959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2008-a3fc-400c-8cac-ab4d8229a980 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.939538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 758/1503] 10.222.0.71 () {54 vars in 964 bytes} [Tue Aug 2 09:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:18:54.946186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6e96-dfc0-4e0c-9264-7f95e2479a08 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:54.946474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6e96-dfc0-4e0c-9264-7f95e2479a08 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:54.946757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6e96-dfc0-4e0c-9264-7f95e2479a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:54.979572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:55.025309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0f1e6e96-dfc0-4e0c-9264-7f95e2479a08 None None] MFA Rules not processed for user `06a2008ab3a2497eba5e8394277c2316`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:55.027244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0f1e6e96-dfc0-4e0c-9264-7f95e2479a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:55.103623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 746/1504] 10.222.0.71 () {58 vars in 1061 bytes} [Tue Aug 2 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:55.111631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2008-a3fc-400c-8cac-ab4d8229a980 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:55.113778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-024d2008-a3fc-400c-8cac-ab4d8229a980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:55.164296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:55.216964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2008-a3fc-400c-8cac-ab4d8229a980 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:55.295698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:55.296498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.296781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.297053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.298705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:55.398598 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:55.400037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:55.403509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:55.417706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 759/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:18:55.464103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c21b-9e38-478b-8982-dcd52f75279f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.464515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c21b-9e38-478b-8982-dcd52f75279f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.464652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c21b-9e38-478b-8982-dcd52f75279f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.465969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 747/1506] 10.222.0.71 () {52 vars in 830 bytes} [Tue Aug 2 09:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:18:55.469459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:55.470693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:55.569171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060059-42f8-4ff6-8761-552029b33e45 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:55.663482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:55.664116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:55.664423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:55.664697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] PATH_INFO: `/v3/users/757aeddb78f14d699df2c643310dda5a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:55.677476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757aeddb78f14d699df2c643310dda5a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:55.678520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:55.678520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: warnings.warn(msg) Aug 02 09:18:55.678520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: Aug 02 09:18:55.679721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:55.689127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:55.886069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757aeddb78f14d699df2c643310dda5a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.886604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757aeddb78f14d699df2c643310dda5a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:55.910882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757aeddb78f14d699df2c643310dda5a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.012567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757aeddb78f14d699df2c643310dda5a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.012933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757aeddb78f14d699df2c643310dda5a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:56.033769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 760/1507] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:18:55 2022] DELETE /identity/v3/users/757aeddb78f14d699df2c643310dda5a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:18:56.039131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.039517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.039800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.096703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:18:56.098724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.173024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:56.185325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 748/1508] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:18:56.195281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:56.196499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.299889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42269d7b-5076-443b-ad8d-364185f88533 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:56.355583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:56.375151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd67189-fa5f-465e-ae84-5958a3fd4cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:56.375772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd67189-fa5f-465e-ae84-5958a3fd4cec service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:56.376053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd67189-fa5f-465e-ae84-5958a3fd4cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:56.376333 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd67189-fa5f-465e-ae84-5958a3fd4cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:56.378002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8dd67189-fa5f-465e-ae84-5958a3fd4cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:56.488106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd67189-fa5f-465e-ae84-5958a3fd4cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:56.489551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd67189-fa5f-465e-ae84-5958a3fd4cec service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:56.509056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 761/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:18:57.006285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:18:57.007505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:18:57.022593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b0643-ee48-4585-950e-6121585e1e9b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:18:57.119374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:18:57.120070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:18:57.120293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:18:57.120567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] PATH_INFO: `/v3/projects/27e6717788ca4155b97ceeba3897091b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:18:57.130620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e6717788ca4155b97ceeba3897091b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:18:57.131637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:18:57.131637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:18:57.131637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:18:57.132821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:18:57.245961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e6717788ca4155b97ceeba3897091b', 'request_id': 'req-d7e83c92-16aa-4262-a7df-7dce455a5100'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:57.252151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e6717788ca4155b97ceeba3897091b', 'request_id': 'req-d7e83c92-16aa-4262-a7df-7dce455a5100'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:57.326413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e6717788ca4155b97ceeba3897091b', 'request_id': 'req-d7e83c92-16aa-4262-a7df-7dce455a5100'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:57.357956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] The token cache is being invalidate because project 27e6717788ca4155b97ceeba3897091b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:18:57.358289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:57.358826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d7e83c92-16aa-4262-a7df-7dce455a5100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:18:57.360234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 749/1510] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:18:57 2022] DELETE /identity/v3/projects/27e6717788ca4155b97ceeba3897091b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:19:06.506696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=62 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:07.355776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:45.921054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070712-ac2a-4d1e-83b5-7af0723ca830 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:45.924692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070712-ac2a-4d1e-83b5-7af0723ca830 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:45.924692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070712-ac2a-4d1e-83b5-7af0723ca830 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:45.924692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:20:45.927863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1761-43b2-47c8-b6e0-9905e884f872 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:45.928283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1761-43b2-47c8-b6e0-9905e884f872 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:45.928486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1761-43b2-47c8-b6e0-9905e884f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:46.011726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a6ff1761-43b2-47c8-b6e0-9905e884f872 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:46.012946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a6ff1761-43b2-47c8-b6e0-9905e884f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:46.120634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:46.277242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070712-ac2a-4d1e-83b5-7af0723ca830 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:46.282122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-db070712-ac2a-4d1e-83b5-7af0723ca830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:46.399474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070712-ac2a-4d1e-83b5-7af0723ca830 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:46.404948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdc046-8144-4afa-a1b3-13e042eeaf1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:46.405554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc046-8144-4afa-a1b3-13e042eeaf1b service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:46.405859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc046-8144-4afa-a1b3-13e042eeaf1b service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:46.406136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc046-8144-4afa-a1b3-13e042eeaf1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:46.415122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdc046-8144-4afa-a1b3-13e042eeaf1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:46.416720 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdc046-8144-4afa-a1b3-13e042eeaf1b service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:46.426042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 763/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:47.260198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057ea4-960a-437f-8a49-2df229631c7a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:47.260767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057ea4-960a-437f-8a49-2df229631c7a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:47.260767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057ea4-960a-437f-8a49-2df229631c7a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:47.262267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:20:47.267265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d40a-c100-439f-b2ae-42ed748eea54 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:47.267702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d40a-c100-439f-b2ae-42ed748eea54 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:47.267851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d40a-c100-439f-b2ae-42ed748eea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:47.287886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f8a1d40a-c100-439f-b2ae-42ed748eea54 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:47.289094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f8a1d40a-c100-439f-b2ae-42ed748eea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:47.297000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:47.451370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057ea4-960a-437f-8a49-2df229631c7a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:47.466253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057ea4-960a-437f-8a49-2df229631c7a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:47.471616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f234453-7acd-4553-9604-d310416d4630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:47.472210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234453-7acd-4553-9604-d310416d4630 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:47.472490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234453-7acd-4553-9604-d310416d4630 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:47.472766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234453-7acd-4553-9604-d310416d4630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:47.482337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f234453-7acd-4553-9604-d310416d4630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:47.484001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f234453-7acd-4553-9604-d310416d4630 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:47.494122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 752/1516] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:47.572381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e669-e12b-44cb-9965-ff5b54783520 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:47.572706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e669-e12b-44cb-9965-ff5b54783520 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:47.572995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e669-e12b-44cb-9965-ff5b54783520 None None] PATH_INFO: `/v3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:47.574413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 765/1517] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 2 09:20:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:20:47.581050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574981-e01e-458c-b2ea-16ad4469d703 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:47.581419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574981-e01e-458c-b2ea-16ad4469d703 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:47.581789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574981-e01e-458c-b2ea-16ad4469d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:47.643123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-71574981-e01e-458c-b2ea-16ad4469d703 None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:47.644335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-71574981-e01e-458c-b2ea-16ad4469d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:47.662128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:47.716698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 753/1518] 10.222.0.104 () {58 vars in 1016 bytes} [Tue Aug 2 09:20:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:56.844518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66944eb-55a1-473d-aac5-ee6dc9068843 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:56.845060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66944eb-55a1-473d-aac5-ee6dc9068843 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:56.845060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66944eb-55a1-473d-aac5-ee6dc9068843 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:56.846360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 766/1519] 10.222.0.71 () {54 vars in 961 bytes} [Tue Aug 2 09:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:20:56.851393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f9481-9e45-490f-8f85-41a4c50d3344 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:56.851828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f9481-9e45-490f-8f85-41a4c50d3344 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:56.851949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f9481-9e45-490f-8f85-41a4c50d3344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:56.872628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-757f9481-9e45-490f-8f85-41a4c50d3344 None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:56.873887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-757f9481-9e45-490f-8f85-41a4c50d3344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:56.882502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 754/1520] 10.222.0.71 () {58 vars in 1058 bytes} [Tue Aug 2 09:20:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:56.890476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66944eb-55a1-473d-aac5-ee6dc9068843 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:56.904539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66944eb-55a1-473d-aac5-ee6dc9068843 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:56.909582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a8a1b-1f16-4a92-8c0e-ca0cb4fa3f92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41aaa2d337974ae29ef28b1126e70435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:56.910207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a8a1b-1f16-4a92-8c0e-ca0cb4fa3f92 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:56.910491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a8a1b-1f16-4a92-8c0e-ca0cb4fa3f92 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:56.910769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a8a1b-1f16-4a92-8c0e-ca0cb4fa3f92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:56.919646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a8a1b-1f16-4a92-8c0e-ca0cb4fa3f92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:56.921221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a8a1b-1f16-4a92-8c0e-ca0cb4fa3f92 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:56.931197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 767/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:58.790538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d510-5639-4efa-85b3-2e75dca9c479 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:58.791109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d510-5639-4efa-85b3-2e75dca9c479 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:58.791109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d510-5639-4efa-85b3-2e75dca9c479 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:58.792471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:20:58.797503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5b53-760c-425b-9305-b6f2138169f4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:58.797977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5b53-760c-425b-9305-b6f2138169f4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:58.798230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5b53-760c-425b-9305-b6f2138169f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:58.819045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0fcb5b53-760c-425b-9305-b6f2138169f4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:58.820204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0fcb5b53-760c-425b-9305-b6f2138169f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:58.829969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:20:58.986084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164d510-5639-4efa-85b3-2e75dca9c479 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:20:59.001766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164d510-5639-4efa-85b3-2e75dca9c479 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:20:59.007266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb941240-5b9a-4944-a307-51d598095a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:20:59.007869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941240-5b9a-4944-a307-51d598095a4d service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:59.008694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941240-5b9a-4944-a307-51d598095a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:59.009242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941240-5b9a-4944-a307-51d598095a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:59.018213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb941240-5b9a-4944-a307-51d598095a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:20:59.019874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb941240-5b9a-4944-a307-51d598095a4d service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:20:59.030498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 756/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:20:59.849429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfccb1-47b9-4afe-a38e-cf8d8422aa5c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:59.849998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfccb1-47b9-4afe-a38e-cf8d8422aa5c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:59.849998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfccb1-47b9-4afe-a38e-cf8d8422aa5c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:59.851400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 09:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:20:59.856252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313a0b-7192-4838-a370-dd3b4c47bd65 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:20:59.856653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313a0b-7192-4838-a370-dd3b4c47bd65 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:20:59.856823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313a0b-7192-4838-a370-dd3b4c47bd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:20:59.877766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-40313a0b-7192-4838-a370-dd3b4c47bd65 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:20:59.878990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-40313a0b-7192-4838-a370-dd3b4c47bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:20:59.887686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 09:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:21:00.040744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfccb1-47b9-4afe-a38e-cf8d8422aa5c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:21:00.056240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfccb1-47b9-4afe-a38e-cf8d8422aa5c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:21:00.061697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28d95b-5785-403e-a999-0477a9a59ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:21:00.062328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d95b-5785-403e-a999-0477a9a59ac1 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:00.062615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d95b-5785-403e-a999-0477a9a59ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:00.062895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d95b-5785-403e-a999-0477a9a59ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:00.071344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28d95b-5785-403e-a999-0477a9a59ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:21:00.073431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28d95b-5785-403e-a999-0477a9a59ac1 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:21:00.082992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 770/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:21:03.826282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51de731-abb1-42f1-998e-f5b1a99ac4ef None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:03.826850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51de731-abb1-42f1-998e-f5b1a99ac4ef None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:03.826850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51de731-abb1-42f1-998e-f5b1a99ac4ef None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:03.828242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:21:03.833554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd601e-00d7-4622-9149-ed1b89ba3a20 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:03.833969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd601e-00d7-4622-9149-ed1b89ba3a20 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:03.834136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd601e-00d7-4622-9149-ed1b89ba3a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:03.855342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-91dd601e-00d7-4622-9149-ed1b89ba3a20 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:21:03.856704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91dd601e-00d7-4622-9149-ed1b89ba3a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:03.864801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:21:03.941096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51de731-abb1-42f1-998e-f5b1a99ac4ef None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:21:03.942866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d51de731-abb1-42f1-998e-f5b1a99ac4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:04.022215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51de731-abb1-42f1-998e-f5b1a99ac4ef None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:21:04.026342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85609e-5338-40ec-b74b-82ba2febb87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:21:04.026947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85609e-5338-40ec-b74b-82ba2febb87d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:04.027257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85609e-5338-40ec-b74b-82ba2febb87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:04.027534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85609e-5338-40ec-b74b-82ba2febb87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:04.036411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85609e-5338-40ec-b74b-82ba2febb87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:21:04.037883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85609e-5338-40ec-b74b-82ba2febb87d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:21:04.047869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 759/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:21:06.083774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83746-8957-4525-b835-943b797d88cb None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:06.084337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83746-8957-4525-b835-943b797d88cb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:06.084337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83746-8957-4525-b835-943b797d88cb None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:06.085671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:21:06.091552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669e6c-9788-4fe7-9be8-aadfe01b7d58 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:06.092004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669e6c-9788-4fe7-9be8-aadfe01b7d58 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:06.092102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669e6c-9788-4fe7-9be8-aadfe01b7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:06.111306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9b669e6c-9788-4fe7-9be8-aadfe01b7d58 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:21:06.112522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9b669e6c-9788-4fe7-9be8-aadfe01b7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:06.121694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:21:06.157564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83746-8957-4525-b835-943b797d88cb None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:21:06.168770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f83746-8957-4525-b835-943b797d88cb None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:21:06.172228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb660d-7aaa-4ff9-adf1-bfe6a8287f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:21:06.172813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb660d-7aaa-4ff9-adf1-bfe6a8287f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:06.173090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb660d-7aaa-4ff9-adf1-bfe6a8287f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:06.173362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb660d-7aaa-4ff9-adf1-bfe6a8287f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:06.183031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb660d-7aaa-4ff9-adf1-bfe6a8287f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:21:06.184442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb660d-7aaa-4ff9-adf1-bfe6a8287f24 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:21:06.193599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 773/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:21:09.606928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf854d2-a6d1-45c2-919e-d4ca99401ad0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:09.607456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf854d2-a6d1-45c2-919e-d4ca99401ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:09.607456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf854d2-a6d1-45c2-919e-d4ca99401ad0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:09.608771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:21:09.613857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac494c78-cc08-4d46-ba89-5176256aa0df None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:09.614289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac494c78-cc08-4d46-ba89-5176256aa0df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:09.614404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac494c78-cc08-4d46-ba89-5176256aa0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:09.623265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=81 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:09.635274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ac494c78-cc08-4d46-ba89-5176256aa0df None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:21:09.636581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ac494c78-cc08-4d46-ba89-5176256aa0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:09.644776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:21:09.958138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf854d2-a6d1-45c2-919e-d4ca99401ad0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:21:09.959882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dbf854d2-a6d1-45c2-919e-d4ca99401ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:10.026808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:10.039779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf854d2-a6d1-45c2-919e-d4ca99401ad0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:21:10.044226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c327de8-612f-4282-943c-8cf5ca1f9a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:21:10.044880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c327de8-612f-4282-943c-8cf5ca1f9a90 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:10.045185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c327de8-612f-4282-943c-8cf5ca1f9a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:10.045466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c327de8-612f-4282-943c-8cf5ca1f9a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:10.054688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c327de8-612f-4282-943c-8cf5ca1f9a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:21:10.056134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c327de8-612f-4282-943c-8cf5ca1f9a90 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:21:10.066086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 762/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:21:12.087364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37885-6131-4552-8361-a52fe2c9f368 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:12.087924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37885-6131-4552-8361-a52fe2c9f368 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:12.087924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37885-6131-4552-8361-a52fe2c9f368 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:12.090264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 09:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:21:12.095544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d158-db33-41ee-a7f6-ee4d80b802df None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:12.095979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d158-db33-41ee-a7f6-ee4d80b802df None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:12.096109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d158-db33-41ee-a7f6-ee4d80b802df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:12.115954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9d54d158-db33-41ee-a7f6-ee4d80b802df None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:21:12.117230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9d54d158-db33-41ee-a7f6-ee4d80b802df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:12.125711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 09:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:21:12.430793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37885-6131-4552-8361-a52fe2c9f368 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:21:12.432630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d1a37885-6131-4552-8361-a52fe2c9f368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:21:12.445658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37885-6131-4552-8361-a52fe2c9f368 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:21:12.449382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e22635-de33-4355-b46a-aad7524d8aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:21:12.450039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e22635-de33-4355-b46a-aad7524d8aee service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:21:12.450326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e22635-de33-4355-b46a-aad7524d8aee service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:21:12.450607 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e22635-de33-4355-b46a-aad7524d8aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:21:12.459611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e22635-de33-4355-b46a-aad7524d8aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:21:12.461028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e22635-de33-4355-b46a-aad7524d8aee service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:21:12.470923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 776/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:21:22.110822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=11 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:22.466779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=8 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:44.393733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d396e-d8f7-49cb-96ad-4ce80f97dd6c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.398217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d396e-d8f7-49cb-96ad-4ce80f97dd6c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.398217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d396e-d8f7-49cb-96ad-4ce80f97dd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.422983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2f1d396e-d8f7-49cb-96ad-4ce80f97dd6c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.424991 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2f1d396e-d8f7-49cb-96ad-4ce80f97dd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.440278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 764/1540] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.449994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f5b3-4f97-41d8-ac6a-4ac3a7180f7b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.450591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f5b3-4f97-41d8-ac6a-4ac3a7180f7b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.450591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461f5b3-4f97-41d8-ac6a-4ac3a7180f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.478917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6461f5b3-4f97-41d8-ac6a-4ac3a7180f7b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.480123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6461f5b3-4f97-41d8-ac6a-4ac3a7180f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.492064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 777/1541] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.497508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d396e-d8f7-49cb-96ad-4ce80f97dd6c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:44.513493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d396e-d8f7-49cb-96ad-4ce80f97dd6c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:44.523644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc1f8d-0af9-4e4b-803b-51cb5fa1ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:44.524552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1f8d-0af9-4e4b-803b-51cb5fa1ecce admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.524839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1f8d-0af9-4e4b-803b-51cb5fa1ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.525117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc1f8d-0af9-4e4b-803b-51cb5fa1ecce admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.525861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1f8d-0af9-4e4b-803b-51cb5fa1ecce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:44.526169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1f8d-0af9-4e4b-803b-51cb5fa1ecce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:44.527785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc1f8d-0af9-4e4b-803b-51cb5fa1ecce admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:44.544283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 765/1542] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:44.553618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461f5b3-4f97-41d8-ac6a-4ac3a7180f7b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:44.566133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461f5b3-4f97-41d8-ac6a-4ac3a7180f7b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:44.573512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:44.574165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.574448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.574725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.575407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:44.577323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:44.617060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5899af-5ebb-4c3c-a944-8aff5a6077c1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.617449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5899af-5ebb-4c3c-a944-8aff5a6077c1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.617635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5899af-5ebb-4c3c-a944-8aff5a6077c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.656514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9d5899af-5ebb-4c3c-a944-8aff5a6077c1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.657700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9d5899af-5ebb-4c3c-a944-8aff5a6077c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.668030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 766/1543] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.684576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7426d-fbfb-49e2-be7d-b87c3343aee2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.684908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7426d-fbfb-49e2-be7d-b87c3343aee2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.685025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 778/1544] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:44.685131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7426d-fbfb-49e2-be7d-b87c3343aee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.690169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:44.722900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aec7426d-fbfb-49e2-be7d-b87c3343aee2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.724136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aec7426d-fbfb-49e2-be7d-b87c3343aee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.793999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad83fa-3bf2-4608-820e-4d20b2a6773e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:44.798880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7dd9c-4778-4dfc-8ec0-e7127e306840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:44.799509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7dd9c-4778-4dfc-8ec0-e7127e306840 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.799794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7dd9c-4778-4dfc-8ec0-e7127e306840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.800071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7dd9c-4778-4dfc-8ec0-e7127e306840 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.800735 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7dd9c-4778-4dfc-8ec0-e7127e306840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:44.801769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-17a7dd9c-4778-4dfc-8ec0-e7127e306840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:22:44.801769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: warnings.warn(msg) Aug 02 09:22:44.801769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: Aug 02 09:22:44.802922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 767/1545] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:22:44.803115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7dd9c-4778-4dfc-8ec0-e7127e306840 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:44.803978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223190b-0731-464f-a3fd-7c2e67706c73 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.804268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223190b-0731-464f-a3fd-7c2e67706c73 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.804547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223190b-0731-464f-a3fd-7c2e67706c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.824810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5223190b-0731-464f-a3fd-7c2e67706c73 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.829393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5223190b-0731-464f-a3fd-7c2e67706c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.835347 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 768/1546] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.836511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e222bcf-a8a8-4951-98f7-124dd3946a65 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.836790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e222bcf-a8a8-4951-98f7-124dd3946a65 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.837071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e222bcf-a8a8-4951-98f7-124dd3946a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.861755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6e222bcf-a8a8-4951-98f7-124dd3946a65 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.861755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6e222bcf-a8a8-4951-98f7-124dd3946a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.866874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 779/1547] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:44.868746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf6cb-c4aa-4e96-82c6-e072bfa23ded None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.869036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf6cb-c4aa-4e96-82c6-e072bfa23ded None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.869315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf6cb-c4aa-4e96-82c6-e072bfa23ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.881235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 769/1548] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.881235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b563a1-f2c3-4fcf-8bc0-02a0eaf212ae None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.881235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b563a1-f2c3-4fcf-8bc0-02a0eaf212ae None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.881235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b563a1-f2c3-4fcf-8bc0-02a0eaf212ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.894310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e04cf6cb-c4aa-4e96-82c6-e072bfa23ded None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.895684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e04cf6cb-c4aa-4e96-82c6-e072bfa23ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.899253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d2b563a1-f2c3-4fcf-8bc0-02a0eaf212ae None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.904073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d2b563a1-f2c3-4fcf-8bc0-02a0eaf212ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.904195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 780/1549] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.904995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623faf34-6929-4739-906b-8da3d10e85cd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.905284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623faf34-6929-4739-906b-8da3d10e85cd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.905569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623faf34-6929-4739-906b-8da3d10e85cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.908855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 770/1550] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.910690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b563a1-f2c3-4fcf-8bc0-02a0eaf212ae None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:44.922707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b563a1-f2c3-4fcf-8bc0-02a0eaf212ae None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:44.925067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-623faf34-6929-4739-906b-8da3d10e85cd None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.926361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-623faf34-6929-4739-906b-8da3d10e85cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.928090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:44.928704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.928990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.929269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.930122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:44.930432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:44.932189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:44.934427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 781/1551] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.935618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011aaf0-c9de-4a8b-acd4-3441a3b01bd6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.935902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011aaf0-c9de-4a8b-acd4-3441a3b01bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.936361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011aaf0-c9de-4a8b-acd4-3441a3b01bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.946144 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 771/1552] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:44.946849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:44.957259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42d35-d922-4af9-bb14-2c3d035a65f7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:44.958217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1011aaf0-c9de-4a8b-acd4-3441a3b01bd6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.959508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1011aaf0-c9de-4a8b-acd4-3441a3b01bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.961931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c15cb-c390-46e1-9737-80e6456b098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:44.962529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c15cb-c390-46e1-9737-80e6456b098d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.962812 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c15cb-c390-46e1-9737-80e6456b098d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.963095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c15cb-c390-46e1-9737-80e6456b098d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.963782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c15cb-c390-46e1-9737-80e6456b098d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:44.965426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c15cb-c390-46e1-9737-80e6456b098d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:44.967514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 782/1553] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.968517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f0191-7771-421b-89a5-ab280397744c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.968797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f0191-7771-421b-89a5-ab280397744c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.969071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f0191-7771-421b-89a5-ab280397744c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.981775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 772/1554] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:44.981775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1897-b2c5-4d89-b631-fe0c2c43b96f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.981775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1897-b2c5-4d89-b631-fe0c2c43b96f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.981775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1897-b2c5-4d89-b631-fe0c2c43b96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:44.988855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a83f0191-7771-421b-89a5-ab280397744c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:44.990102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a83f0191-7771-421b-89a5-ab280397744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:44.998203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 783/1555] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:44.999374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d26d-b3a2-4e67-85f6-5f948f80e116 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:44.999656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d26d-b3a2-4e67-85f6-5f948f80e116 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:44.999929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d26d-b3a2-4e67-85f6-5f948f80e116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.001177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-354c1897-b2c5-4d89-b631-fe0c2c43b96f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.003124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-354c1897-b2c5-4d89-b631-fe0c2c43b96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.011743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 773/1556] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:45.013020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6620d8-357f-4fb3-b66a-e4d00fde9645 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.013313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6620d8-357f-4fb3-b66a-e4d00fde9645 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.013591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6620d8-357f-4fb3-b66a-e4d00fde9645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.021544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f9a8d26d-b3a2-4e67-85f6-5f948f80e116 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.022764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9a8d26d-b3a2-4e67-85f6-5f948f80e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.030557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 784/1557] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:45.032544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6693-ad56-4002-97ba-2e38b06a05fd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.033339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6693-ad56-4002-97ba-2e38b06a05fd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.033658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6693-ad56-4002-97ba-2e38b06a05fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.033946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3a6620d8-357f-4fb3-b66a-e4d00fde9645 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.035228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3a6620d8-357f-4fb3-b66a-e4d00fde9645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.043197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 774/1558] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:45.044156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6620d8-357f-4fb3-b66a-e4d00fde9645 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.054363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6620d8-357f-4fb3-b66a-e4d00fde9645 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.054629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-fd5c6693-ad56-4002-97ba-2e38b06a05fd None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.055825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fd5c6693-ad56-4002-97ba-2e38b06a05fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.058955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.059558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.059845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.060123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.060784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.061840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:22:45.061840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:22:45.061840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:22:45.063042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.063658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 785/1559] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:45.064521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6693-ad56-4002-97ba-2e38b06a05fd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.074183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6693-ad56-4002-97ba-2e38b06a05fd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.078757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.079448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.081773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.081773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.081773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:45.081773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.082302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:22:45.082302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: warnings.warn(msg) Aug 02 09:22:45.082302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: Aug 02 09:22:45.083107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.096032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 786/1560] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:45.096879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.107030 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90bdc-82b5-40b6-89a3-cf11a68e8ee2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.112499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58283c0-9324-48b1-9127-a60730c579ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.113085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58283c0-9324-48b1-9127-a60730c579ee admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.113371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58283c0-9324-48b1-9127-a60730c579ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.113652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58283c0-9324-48b1-9127-a60730c579ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.114515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58283c0-9324-48b1-9127-a60730c579ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.116078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58283c0-9324-48b1-9127-a60730c579ee admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.126904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 787/1561] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:45.128048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0d23-8811-41aa-8175-1efb30cf93e2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.128335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0d23-8811-41aa-8175-1efb30cf93e2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.128615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0d23-8811-41aa-8175-1efb30cf93e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.148133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bbaa0d23-8811-41aa-8175-1efb30cf93e2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.149433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bbaa0d23-8811-41aa-8175-1efb30cf93e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.157384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 788/1562] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:45.161501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa0d23-8811-41aa-8175-1efb30cf93e2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.169837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa0d23-8811-41aa-8175-1efb30cf93e2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.175218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.175793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.176080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.176359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.177044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:45.177456 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.179091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.186447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 775/1563] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/projects => generated 355 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:45.187349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.198606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 789/1564] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:45.198606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.203723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de594dd-47c6-4d5a-81be-9137361b2eae admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.231093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:45.256070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:45.261452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af12e1f-5fec-46da-9b19-3ff32d7e9fbc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.265361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.266192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.266349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.266552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.266809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.266925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.267644 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.268054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:45.268184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.268360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.268788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:45.269092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.270170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.270805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.282112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 790/1565] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:45.283671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 776/1566] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:45.283810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.290773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.294263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f2555-75ef-41da-81e6-f99ff60d07c5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.300046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.300664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.300950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.301228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.301695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff4ad-c27b-4928-8e17-27ff576fadca admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.301950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:45.302260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.303859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.306841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.307433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.307717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.307995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.308663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.311168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.317265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 791/1567] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:45.317906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.328497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd494a7-a9c8-463d-a708-b98aef05c392 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.334065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.334720 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.338233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.338233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] PATH_INFO: `/v3/projects/9676be4fe3c94ab6805dc5dd92ff677e/users/31bbdf48394f41f7945ae4affb13a6be/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.350574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9676be4fe3c94ab6805dc5dd92ff677e, user_id=31bbdf48394f41f7945ae4affb13a6be, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.353219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.398242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 777/1568] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:45.399082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.419517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 792/1569] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:45 2022] PUT /identity/v3/projects/9676be4fe3c94ab6805dc5dd92ff677e/users/31bbdf48394f41f7945ae4affb13a6be/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:45.420076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.465546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558c593-f715-40b5-960c-55685a1ba701 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.483401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363551-303c-4355-980b-1a3ca601795e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.488264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.488900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.489158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.489437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.490164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.492178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.524791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.525408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.525765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.526051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.526755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:45.527062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.528800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.541809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 778/1570] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:45.542863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.553135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08207544-f01e-4d95-8263-cc2639e461d5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.557796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.562431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.562431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.562431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.562431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.562431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.578817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 793/1571] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/users => generated 278 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:45.580975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.590557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dc21e-3c01-481a-bead-d7727b5083fd admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.595152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.596890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.597170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.597448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.598134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.600068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.657575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 779/1572] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:45.657575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.691435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 794/1573] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:45.692453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.704288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:45.719176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e209-6a2c-40d9-a6f2-cafb14167764 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.748338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:45.760896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baabdec-7188-45d9-af76-a906e248a9f1 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.765981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.766603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.766888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.767785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.768575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.770517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.782353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f55fe-2197-4b6f-bad7-16a25a8062f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.783236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f55fe-2197-4b6f-bad7-16a25a8062f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.783523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f55fe-2197-4b6f-bad7-16a25a8062f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.784472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f55fe-2197-4b6f-bad7-16a25a8062f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.785295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f55fe-2197-4b6f-bad7-16a25a8062f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.787305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f55fe-2197-4b6f-bad7-16a25a8062f2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:45.872629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 795/1574] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/projects => generated 393 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:45.873511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.887769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 780/1575] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:45.887769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f6e5f-265d-45f3-8e58-cb1fa93208cf None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.887769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f6e5f-265d-45f3-8e58-cb1fa93208cf None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.887769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f6e5f-265d-45f3-8e58-cb1fa93208cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.906248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-003f6e5f-265d-45f3-8e58-cb1fa93208cf None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:45.910299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-003f6e5f-265d-45f3-8e58-cb1fa93208cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:45.940005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e170a-66fd-4c3c-a319-a58c3e3b9935 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.976646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 781/1576] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:45.976646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f6e5f-265d-45f3-8e58-cb1fa93208cf None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:45.982676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f6e5f-265d-45f3-8e58-cb1fa93208cf None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:45.988236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:45.988860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:45.989141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:45.989422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:45.990127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:45.992101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.004805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.007923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.007923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.007923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.007923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.008696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.132772 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 782/1577] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:46.132772 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.139417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 796/1578] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:45 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:46.140274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.150415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e78e2a-e589-49bc-9b78-9ecc101cdeb9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.193429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:46.197921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165fbf3-3f91-4eaf-946f-74be6d8ca063 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.202832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.203449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.205842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.205842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.205842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.207169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.207711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.208333 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.208621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.208900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.209569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.211710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.220113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 783/1579] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.220113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.228775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806129-7395-46d0-bce8-464beb71bfe5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.233281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.233932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.234219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.234480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.235134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.238063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.310575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 797/1580] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:46 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:46.311662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.319041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:46.325535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 784/1581] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:46 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:46.325677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65d90-3c75-4d19-b2c9-17dbff04624c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.325848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.330289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.330948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.331229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.331508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.332169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.333336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be53da-3a43-4590-9ff4-566b9b639ae0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.334155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.338147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.338744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.339059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.339342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.340001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.341993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.425651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 785/1582] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:46 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:46.429127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 798/1583] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:46 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:46.429127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.429364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.438319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022081a-abfd-4e04-86e5-8859ff2a3738 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.443349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.457079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.457079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.457079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.457079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.457079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.485835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dad290-91f6-4f16-9db7-c0515afabf05 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.490639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.491251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.491535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.491814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.500944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.502500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.512002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 786/1584] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:46.512859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.522229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876805f-4d26-49b0-82e1-41f40b9b101e service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.526843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.532433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.532433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.532433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.532433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.532433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.541299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 787/1585] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.542224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.552959 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d974c-fd3b-4d22-b90e-d7618170f196 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.559633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 799/1586] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:46 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:46.559633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.560226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.560226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.560226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.560226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.560592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.561524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.567524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77679acc-363a-425b-8aa9-cde82345a310 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.572479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.572647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 788/1587] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.573093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.573370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.573482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.573669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.574390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.576265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.583678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64070d-6ecb-4042-b3a6-44b495a5c2b6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.589685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 800/1588] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.589685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.593030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.593769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.593953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.594232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.594933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.597546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.599702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919d597-5d19-4a70-808d-6e577f37991f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.604748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.605578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.605946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.606193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.606995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.608877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.610225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 789/1589] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.611675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.622188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41805c26-4b0d-406f-a275-79989b35feec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.627603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.628907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.628997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 801/1590] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.629095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.629095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.629327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.629693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.631333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.640757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280d95e-d805-4c87-94a5-4cfaf857fc39 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.642489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 790/1591] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.649420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.649554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.649554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.649554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.649554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.649985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.651787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.656019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e57d-9b95-4f71-a687-40e1d10046bf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.661673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.664889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.664889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.664889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.664889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.665249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 802/1592] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.665859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.669149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.679172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 791/1593] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.679172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.684801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad29e3-cacb-4ee3-a9db-e18e61be31e2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.690799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d197-01d8-402d-826a-a2348f71da8f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.691495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.692226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.692516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.692804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] PATH_INFO: `/v3/projects/1b3910d95a2f446b94c80803daa403d9/users/edbaf0eb415046ddb2e4da092c8ff1de/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.696770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.697242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.697640 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.698041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.698953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.700619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.710281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3910d95a2f446b94c80803daa403d9, user_id=edbaf0eb415046ddb2e4da092c8ff1de, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.712635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 792/1594] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.713059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.713567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.724032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed47f23-4fc9-42bb-a6a6-713c9c29a0a0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.729446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.729446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.729446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.729794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.730328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.731901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.742249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 793/1595] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.742763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.753543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bbc15-fadc-47d7-8f6c-2cb632c9e518 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.758372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.758961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.759245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.759522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.760267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.761892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.772758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 794/1596] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.775539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.783843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ac838-795f-422f-a67c-375d2cf9935c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.786782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 803/1597] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:46 2022] PUT /identity/v3/projects/1b3910d95a2f446b94c80803daa403d9/users/edbaf0eb415046ddb2e4da092c8ff1de/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:46.787918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.822998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:46.870298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.871066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.871349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.871622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.872328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.874288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.875882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723b80-733e-45e4-813d-ec539f86d02c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.882541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.883533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.883823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.884103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] PATH_INFO: `/v3/projects/67d335922f2845c49bac46273125a246/users/f6d86c4ecd7e4681b8942837246ecefa/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.888217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 795/1598] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.889113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.900690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7efe0c-d65e-457e-a489-961af431712f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.904099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d335922f2845c49bac46273125a246, user_id=f6d86c4ecd7e4681b8942837246ecefa, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.906051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.906666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.906897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.907038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.907330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.908471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.910578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.921122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 796/1599] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:46.922658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:46.933556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428d3e-5e63-4283-b0db-05fd643f6af6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:46.938985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:46.940240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:46.940550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:46.940814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] PATH_INFO: `/v3/projects/ef3f66c3db574fae8ae5760c508592c2/users/19e502fd45f34837bcf2caff0a82a668/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:46.956100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3f66c3db574fae8ae5760c508592c2, user_id=19e502fd45f34837bcf2caff0a82a668, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:46.957115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:22:46.957115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:22:46.957115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:22:46.959093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:46.967767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 804/1600] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:46 2022] PUT /identity/v3/projects/67d335922f2845c49bac46273125a246/users/f6d86c4ecd7e4681b8942837246ecefa/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:46.976323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.029056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:47.038010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 797/1601] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:46 2022] PUT /identity/v3/projects/ef3f66c3db574fae8ae5760c508592c2/users/19e502fd45f34837bcf2caff0a82a668/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:47.038232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44394-21b8-453d-ac04-d1926e146697 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.038417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.103803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b00eb-7f58-4610-aea1-ff161a551a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.105182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b00eb-7f58-4610-aea1-ff161a551a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.105477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b00eb-7f58-4610-aea1-ff161a551a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.110031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b00eb-7f58-4610-aea1-ff161a551a07 admin admin] PATH_INFO: `/v3/projects/d9e1d12af7964fbbaea2eab3ed3d6847/users/f5a85438fda6446fa7d9b31da11d539b/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.110178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e603e6d-ecfe-4d38-a635-028138c1ec76 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.114208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.115044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.115332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.115618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] PATH_INFO: `/v3/projects/d82ab6fda9db43edaa1a5b25d9f34bec/users/a4a288300a2e4a769073048170a7f673/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.123763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b00eb-7f58-4610-aea1-ff161a551a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e1d12af7964fbbaea2eab3ed3d6847, user_id=f5a85438fda6446fa7d9b31da11d539b, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:47.128291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b00eb-7f58-4610-aea1-ff161a551a07 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:47.138101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82ab6fda9db43edaa1a5b25d9f34bec, user_id=a4a288300a2e4a769073048170a7f673, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:47.138551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:47.218938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 805/1602] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:46 2022] PUT /identity/v3/projects/d9e1d12af7964fbbaea2eab3ed3d6847/users/f5a85438fda6446fa7d9b31da11d539b/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:47.221109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e2b43-67ab-4704-91e6-412196f0b30d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.221612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e2b43-67ab-4704-91e6-412196f0b30d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.221923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e2b43-67ab-4704-91e6-412196f0b30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.249358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-654e2b43-67ab-4704-91e6-412196f0b30d None None] MFA Rules not processed for user `edbaf0eb415046ddb2e4da092c8ff1de`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:47.250518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-654e2b43-67ab-4704-91e6-412196f0b30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:47.271061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 798/1603] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:47 2022] PUT /identity/v3/projects/d82ab6fda9db43edaa1a5b25d9f34bec/users/a4a288300a2e4a769073048170a7f673/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:47.272054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.333365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 806/1604] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:47.334353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e2b43-67ab-4704-91e6-412196f0b30d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.351749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d95f3-c634-4fe6-aab7-8c4d493d71d2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.356364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d71ba1-3d42-4508-82e4-f8536f07306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.357030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d71ba1-3d42-4508-82e4-f8536f07306d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.357494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d71ba1-3d42-4508-82e4-f8536f07306d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.357811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d71ba1-3d42-4508-82e4-f8536f07306d admin admin] PATH_INFO: `/v3/projects/254a6dfd6f804ac39d87ac865dba2fd7/users/e88b4253cdef44f0a1f0a5ca2b5733dc/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.375050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d71ba1-3d42-4508-82e4-f8536f07306d admin admin] RBAC: Authorizing `identity:create_grant(project_id=254a6dfd6f804ac39d87ac865dba2fd7, user_id=e88b4253cdef44f0a1f0a5ca2b5733dc, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:47.378697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d71ba1-3d42-4508-82e4-f8536f07306d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:47.405511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e2b43-67ab-4704-91e6-412196f0b30d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.411843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0d059-9ffc-4fcc-94a4-d9d8560a4d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.412663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d059-9ffc-4fcc-94a4-d9d8560a4d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.412818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d059-9ffc-4fcc-94a4-d9d8560a4d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.413092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d059-9ffc-4fcc-94a4-d9d8560a4d72 admin admin] PATH_INFO: `/v3/projects/79cc750f82184cbf9c3a0cba0528df0d/users/a3a08902bcce45e2862eb2d0d71e4da6/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.429238 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d059-9ffc-4fcc-94a4-d9d8560a4d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cc750f82184cbf9c3a0cba0528df0d, user_id=a3a08902bcce45e2862eb2d0d71e4da6, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:47.432000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d059-9ffc-4fcc-94a4-d9d8560a4d72 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:47.466308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:47.471692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 799/1605] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:47 2022] PUT /identity/v3/projects/254a6dfd6f804ac39d87ac865dba2fd7/users/e88b4253cdef44f0a1f0a5ca2b5733dc/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:47.473015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165107-7a83-413f-bd0d-0b36973a33e5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.473304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165107-7a83-413f-bd0d-0b36973a33e5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.473582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165107-7a83-413f-bd0d-0b36973a33e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.493122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-31165107-7a83-413f-bd0d-0b36973a33e5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:47.494672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-31165107-7a83-413f-bd0d-0b36973a33e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:47.505308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:47.510888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 807/1606] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:47 2022] PUT /identity/v3/projects/79cc750f82184cbf9c3a0cba0528df0d/users/a3a08902bcce45e2862eb2d0d71e4da6/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:47.512253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7c1a-cb9c-48bf-94e9-9bd05963a99a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.512548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7c1a-cb9c-48bf-94e9-9bd05963a99a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.512834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7c1a-cb9c-48bf-94e9-9bd05963a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.539803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-69bf7c1a-cb9c-48bf-94e9-9bd05963a99a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:47.541039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-69bf7c1a-cb9c-48bf-94e9-9bd05963a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:47.558300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 800/1607] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:47.562103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116850-beb8-4850-a0b3-2e0241ae7471 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.562103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116850-beb8-4850-a0b3-2e0241ae7471 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.562103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116850-beb8-4850-a0b3-2e0241ae7471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.582214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f8116850-beb8-4850-a0b3-2e0241ae7471 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:47.583678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f8116850-beb8-4850-a0b3-2e0241ae7471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:47.620038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 808/1608] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:47.621392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fd38-a800-4dc5-80eb-29d21dcafd2b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.621689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fd38-a800-4dc5-80eb-29d21dcafd2b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.622015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fd38-a800-4dc5-80eb-29d21dcafd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.652208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0336fd38-a800-4dc5-80eb-29d21dcafd2b None None] MFA Rules not processed for user `a4a288300a2e4a769073048170a7f673`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:47.653552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0336fd38-a800-4dc5-80eb-29d21dcafd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:47.660360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 801/1609] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:47.661192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8116850-beb8-4850-a0b3-2e0241ae7471 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.671240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8116850-beb8-4850-a0b3-2e0241ae7471 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.676595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.677206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.677493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.677807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.678519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:47.680446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:47.723065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 809/1610] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:47.724354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e88243-2fb9-4238-a831-9feee3f19baa None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.724644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e88243-2fb9-4238-a831-9feee3f19baa None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.724920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e88243-2fb9-4238-a831-9feee3f19baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.744273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-46e88243-2fb9-4238-a831-9feee3f19baa None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:47.745472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-46e88243-2fb9-4238-a831-9feee3f19baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:47.754017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 810/1611] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:47.755295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2eb94-992f-4003-8ef8-e2fcfd69903b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.755631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2eb94-992f-4003-8ef8-e2fcfd69903b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.755864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2eb94-992f-4003-8ef8-e2fcfd69903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.788356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 802/1612] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:47.789508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.795579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8bf2eb94-992f-4003-8ef8-e2fcfd69903b None None] MFA Rules not processed for user `a3a08902bcce45e2862eb2d0d71e4da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:47.796828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8bf2eb94-992f-4003-8ef8-e2fcfd69903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:47.871619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d14ea-4658-4b18-8285-5fa1647dbf29 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.873675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 811/1613] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:47.878709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2eb94-992f-4003-8ef8-e2fcfd69903b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.879399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.879399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.879399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.879727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.885786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2eb94-992f-4003-8ef8-e2fcfd69903b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.893311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.894396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.894396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.894653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:47.905569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:47.929539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:47.962782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:47.965016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:47.974912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:47.976510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:47.977391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 803/1614] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:47.978586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.989585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d437f-ed00-489e-8905-6fc05dc1545b service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:47.989880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 812/1615] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:47.990842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:47.994130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:47.996226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:47.996226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:47.996226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.008398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.009856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.028670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 804/1616] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:48.028670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.029953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382af3a-5c5e-47b0-880f-644946a04da6 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.035105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.035719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.036462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.036748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.049242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.050708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.054452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcefe9a-8d70-49a5-bf3b-5fd7c708698f service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.059542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66b6c4-be64-46f5-82c8-c27bc20df224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.060177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b6c4-be64-46f5-82c8-c27bc20df224 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.060457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b6c4-be64-46f5-82c8-c27bc20df224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.060738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b6c4-be64-46f5-82c8-c27bc20df224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.063483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 805/1617] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:48.064322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.075315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e234b-5d79-4d02-a22f-e710cc751c17 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.080260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.080976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.081264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.081789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.082622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.084647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.124084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66b6c4-be64-46f5-82c8-c27bc20df224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.125560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66b6c4-be64-46f5-82c8-c27bc20df224 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.135918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 813/1618] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:48.137316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf9eca-544b-45bb-970f-18e67fbc8a06 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.137618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf9eca-544b-45bb-970f-18e67fbc8a06 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.137931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf9eca-544b-45bb-970f-18e67fbc8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.174304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1ccf9eca-544b-45bb-970f-18e67fbc8a06 None None] MFA Rules not processed for user `31bbdf48394f41f7945ae4affb13a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:48.174304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1ccf9eca-544b-45bb-970f-18e67fbc8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:48.197517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 806/1619] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:48 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:48.198373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.209583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9067a-5c49-4393-8d27-0c66581e72cf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.215694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.216023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.216316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.216584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.217327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.219700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.245495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:48.276494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 814/1620] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:48.276494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf9eca-544b-45bb-970f-18e67fbc8a06 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.284448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf9eca-544b-45bb-970f-18e67fbc8a06 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.290976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.292291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.292291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.292854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.294718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.297262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.309038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 815/1621] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:48.309972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.322551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc55ae-78b7-47fb-a7b6-333d5ff4516b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.327832 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.334207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 807/1622] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:48 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:48.334207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.334530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.334530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.334530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.334530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.336187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.422415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5013f-f96c-45eb-818b-da1d3f62f926 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.433387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.434414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.434773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.435013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] PATH_INFO: `/v3/projects/205e3722c26341e6a64334ed8e6d38be/users/a38aa68b60e5410898a94a0fc65f7ac7/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.440862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 816/1623] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:48 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:48.443387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.459831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=205e3722c26341e6a64334ed8e6d38be, user_id=a38aa68b60e5410898a94a0fc65f7ac7, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.463271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.542414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e5eab-fceb-4a07-ab7f-1cebcfe41552 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.547517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.548389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.548651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.549001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.549837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.551796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.573799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 808/1624] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:48 2022] PUT /identity/v3/projects/205e3722c26341e6a64334ed8e6d38be/users/a38aa68b60e5410898a94a0fc65f7ac7/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:48.577683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.640973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:48.657812 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c02871-0f85-48d6-b288-e4a9073d0e7c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.663106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 817/1625] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:48 2022] POST /identity/v3/users => generated 309 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:48.663106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.663637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737f748-8e1e-4f15-b117-2ccf559d49e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.664075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737f748-8e1e-4f15-b117-2ccf559d49e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.664075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737f748-8e1e-4f15-b117-2ccf559d49e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.664364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737f748-8e1e-4f15-b117-2ccf559d49e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.665151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737f748-8e1e-4f15-b117-2ccf559d49e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.667122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737f748-8e1e-4f15-b117-2ccf559d49e8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.676236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce371f25-89bd-47ea-a1ca-d6a3bd8182a0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.682864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.683622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.683976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.684313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.685083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.686871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.701692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 818/1626] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:48.701692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.710611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cbd65-694a-49fc-b89c-80e25f64031e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.715279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.715896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.725947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.725947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.725947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.725947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.732908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 819/1627] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:48.732908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.741569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5311-c258-4354-9658-8e61f86bd9c3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:48.747442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:48.748451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.748792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.749217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] PATH_INFO: `/v3/projects/205e3722c26341e6a64334ed8e6d38be/users/a38aa68b60e5410898a94a0fc65f7ac7/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.754899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=205e3722c26341e6a64334ed8e6d38be, user_id=a38aa68b60e5410898a94a0fc65f7ac7, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:48.755067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:48.766331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 820/1628] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:48 2022] PUT /identity/v3/projects/205e3722c26341e6a64334ed8e6d38be/users/a38aa68b60e5410898a94a0fc65f7ac7/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:48.768365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:48.791164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 809/1629] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:48 2022] POST /identity/v3/users => generated 309 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:48.792655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2732b07-22f9-43f4-8928-df642611c1fe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:48.793056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2732b07-22f9-43f4-8928-df642611c1fe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:48.793485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2732b07-22f9-43f4-8928-df642611c1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:48.828551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d2732b07-22f9-43f4-8928-df642611c1fe None None] MFA Rules not processed for user `a38aa68b60e5410898a94a0fc65f7ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:48.830240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d2732b07-22f9-43f4-8928-df642611c1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:49.021101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef68d-202c-4b6b-aaaf-5676a09c05cd admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.021101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.021101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.021101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.022469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] PATH_INFO: `/v3/projects/b91d3ac193674c578d8746a8e03caecf/users/39d46455057f421cad564862f7199875/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.022469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91d3ac193674c578d8746a8e03caecf, user_id=39d46455057f421cad564862f7199875, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.022469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.022469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:49.023005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 810/1630] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:49.023005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2732b07-22f9-43f4-8928-df642611c1fe None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.023005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2732b07-22f9-43f4-8928-df642611c1fe None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.023005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.023741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.023741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.023741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.023741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.023741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.023741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 811/1631] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:49.024910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.064687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b619bf-ac53-44c5-b766-c1b561c51dbe admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.069686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.070569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.071023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.071547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.086741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.091900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.092627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 821/1632] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:48 2022] PUT /identity/v3/projects/b91d3ac193674c578d8746a8e03caecf/users/39d46455057f421cad564862f7199875/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:49.093882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.102169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 812/1633] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:49.103248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.124340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889e9a-a5e5-4257-a0fb-537e34d923a0 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.209052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a0459-af8b-489d-b059-5fb744e5acdb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.214936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.218899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.218899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.218899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.218899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.218899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.238249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 813/1634] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:49.240474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.243617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.244061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.246074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.255301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] PATH_INFO: `/v3/projects/6f7de9b6ea5640b9aff40616b9a29f11/users/39daeadb097b4d47a41f8e68bff20a28/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.258914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33328cf-7db0-4483-868a-1d2c2a6d02f7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.264698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065010-ee29-4418-aee7-0d61c02dad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.265377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065010-ee29-4418-aee7-0d61c02dad50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.265663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065010-ee29-4418-aee7-0d61c02dad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.265980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065010-ee29-4418-aee7-0d61c02dad50 admin admin] PATH_INFO: `/v3/projects/b91d3ac193674c578d8746a8e03caecf/users/39d46455057f421cad564862f7199875/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.268643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065010-ee29-4418-aee7-0d61c02dad50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91d3ac193674c578d8746a8e03caecf, user_id=39d46455057f421cad564862f7199875, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.271397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065010-ee29-4418-aee7-0d61c02dad50 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.272740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7de9b6ea5640b9aff40616b9a29f11, user_id=39daeadb097b4d47a41f8e68bff20a28, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.275828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.286007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 814/1635] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:49 2022] PUT /identity/v3/projects/b91d3ac193674c578d8746a8e03caecf/users/39d46455057f421cad564862f7199875/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:49.296558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2397b88-43cd-44a4-b8ea-34018d1e7321 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.296934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2397b88-43cd-44a4-b8ea-34018d1e7321 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.297410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2397b88-43cd-44a4-b8ea-34018d1e7321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.361601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d2397b88-43cd-44a4-b8ea-34018d1e7321 None None] MFA Rules not processed for user `39d46455057f421cad564862f7199875`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:49.362872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d2397b88-43cd-44a4-b8ea-34018d1e7321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:49.381805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 822/1636] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:49 2022] PUT /identity/v3/projects/6f7de9b6ea5640b9aff40616b9a29f11/users/39daeadb097b4d47a41f8e68bff20a28/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:49.385813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.472066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:49.473747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4584a2f-f343-4fba-94ee-2ad5e5304ec6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.489698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.489698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.489698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.489698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.490382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.490382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.495481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 823/1638] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:22:49.495648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 815/1638] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:49 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:22:49.497088 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.499641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2397b88-43cd-44a4-b8ea-34018d1e7321 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.594518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2397b88-43cd-44a4-b8ea-34018d1e7321 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.601993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.602385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.603401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.603401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] PATH_INFO: `/v3/projects/6f7de9b6ea5640b9aff40616b9a29f11/users/39daeadb097b4d47a41f8e68bff20a28/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.605732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7de9b6ea5640b9aff40616b9a29f11, user_id=39daeadb097b4d47a41f8e68bff20a28, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.609003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.620237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965323-b1e5-4446-b570-06925d8d2d0f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.627170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 816/1639] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:49 2022] PUT /identity/v3/projects/6f7de9b6ea5640b9aff40616b9a29f11/users/39daeadb097b4d47a41f8e68bff20a28/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:49.627664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:49.678224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:49.715342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c21ec8-0bff-413c-9ee6-f8716c28bd71 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:49.719323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.720766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.721061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.721385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.722233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086193c-596a-49b1-8e5e-7334080ae93e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:49.723752 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086193c-596a-49b1-8e5e-7334080ae93e service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:49.724047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086193c-596a-49b1-8e5e-7334080ae93e service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:49.724384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086193c-596a-49b1-8e5e-7334080ae93e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:49.790401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:49.846651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.850269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.877082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086193c-596a-49b1-8e5e-7334080ae93e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:49.878611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086193c-596a-49b1-8e5e-7334080ae93e service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:49.891392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 817/1640] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:49 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:49.895339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 824/1641] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:50.391730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:50.391730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3eeb-21de-43fb-a558-2c09c58d8161 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:50.391730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:50.391730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:50.393469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:50.393469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] PATH_INFO: `/v3/users/a3a08902bcce45e2862eb2d0d71e4da6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:50.393469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a08902bcce45e2862eb2d0d71e4da6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:50.393469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:22:50.393469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: warnings.warn(msg) Aug 02 09:22:50.393469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: Aug 02 09:22:50.393469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:50.648819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a08902bcce45e2862eb2d0d71e4da6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:50.649629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a08902bcce45e2862eb2d0d71e4da6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:50.691948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a08902bcce45e2862eb2d0d71e4da6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:50.716325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a08902bcce45e2862eb2d0d71e4da6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:50.836828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a08902bcce45e2862eb2d0d71e4da6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:50.851376 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 818/1642] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:22:50 2022] DELETE /identity/v3/users/a3a08902bcce45e2862eb2d0d71e4da6 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:50.856817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d31df-b12a-4572-aa85-a5c7d0ac7172 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:50.857413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d31df-b12a-4572-aa85-a5c7d0ac7172 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:50.857908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d31df-b12a-4572-aa85-a5c7d0ac7172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:50.889010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6d7d31df-b12a-4572-aa85-a5c7d0ac7172 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:50.891031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6d7d31df-b12a-4572-aa85-a5c7d0ac7172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:50.985057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 825/1643] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:51.020426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:51.022894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:51.058919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:51.125265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255cfa-3376-4418-ac32-dbfb0e4bb431 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:51.128664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb273f1-900c-4558-b1a9-271c096e6b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:51.130633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb273f1-900c-4558-b1a9-271c096e6b6b service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:51.130633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb273f1-900c-4558-b1a9-271c096e6b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:51.130633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb273f1-900c-4558-b1a9-271c096e6b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:51.141560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb273f1-900c-4558-b1a9-271c096e6b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:51.145435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb273f1-900c-4558-b1a9-271c096e6b6b service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:51.158747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 819/1644] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:52.248246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d01ca-cc09-45af-abd9-b3bc9383bcb1 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:52.248773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d01ca-cc09-45af-abd9-b3bc9383bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:52.250055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d01ca-cc09-45af-abd9-b3bc9383bcb1 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:52.253161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 826/1645] 10.222.0.71 () {54 vars in 962 bytes} [Tue Aug 2 09:22:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:22:52.272707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836a060-b351-4a1e-81d2-2c0f6451325b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:52.279724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836a060-b351-4a1e-81d2-2c0f6451325b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:52.279724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836a060-b351-4a1e-81d2-2c0f6451325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:52.326886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e836a060-b351-4a1e-81d2-2c0f6451325b None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:52.328218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e836a060-b351-4a1e-81d2-2c0f6451325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:52.498059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:52.498351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:52.498679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:52.522097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 820/1646] 10.222.0.71 () {58 vars in 1059 bytes} [Tue Aug 2 09:22:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:52.523614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524f27d-c16c-4f1f-853f-e851c4caf95b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:52.523916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524f27d-c16c-4f1f-853f-e851c4caf95b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:52.526393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524f27d-c16c-4f1f-853f-e851c4caf95b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:52.526393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 821/1647] 10.222.0.71 () {54 vars in 912 bytes} [Tue Aug 2 09:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:22:52.533552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:52.533552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:52.533552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:52.559882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:52.560534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] MFA Rules not processed for user `39daeadb097b4d47a41f8e68bff20a28`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:52.561337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:52.562177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:52.590833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 822/1648] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:22:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:22:52.590833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:52.590833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:52.679491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 827/1649] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:52.734154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b824-a3ca-48ae-a7c3-02edb14b3646 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:52.738536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:52.740095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:52.740564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:52.740910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:52.762576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:52.764396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:52.799368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 823/1650] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:53.077601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:53.079096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:53.106390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e8f03-ceb9-49d2-847d-814efdfeb89e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:53.128485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:53.129452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:53.130004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:53.130501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] PATH_INFO: `/v3/projects/79cc750f82184cbf9c3a0cba0528df0d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:53.133458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cc750f82184cbf9c3a0cba0528df0d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:53.134788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: WARNING py.warnings [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:22:53.134788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: warnings.warn(msg) Aug 02 09:22:53.134788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: Aug 02 09:22:53.136608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:53.139705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:53.300790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cc750f82184cbf9c3a0cba0528df0d', 'request_id': 'req-82a57326-0de5-491f-9cad-8c128912093d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:53.322793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cc750f82184cbf9c3a0cba0528df0d', 'request_id': 'req-82a57326-0de5-491f-9cad-8c128912093d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:53.336359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cc750f82184cbf9c3a0cba0528df0d', 'request_id': 'req-82a57326-0de5-491f-9cad-8c128912093d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:53.529545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] The token cache is being invalidate because project 79cc750f82184cbf9c3a0cba0528df0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:22:53.530121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:53.531457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-82a57326-0de5-491f-9cad-8c128912093d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:53.539500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 828/1651] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:22:53 2022] DELETE /identity/v3/projects/79cc750f82184cbf9c3a0cba0528df0d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:53.540440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:53.569624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06e78-b4b8-4084-b0b8-a3a363fa11b3 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:53.773258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:53.815843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:53.816508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:53.816791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:53.817063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] PATH_INFO: `/v3/users/39d46455057f421cad564862f7199875` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:53.819712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d46455057f421cad564862f7199875)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:53.822086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:54.076759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d46455057f421cad564862f7199875'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:54.077675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d46455057f421cad564862f7199875'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:54.096966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d46455057f421cad564862f7199875'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:54.108715 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d46455057f421cad564862f7199875'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:54.198258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-430e96d7-afb7-4972-bf17-5c704fc24b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d46455057f421cad564862f7199875'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:54.216216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 824/1652] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:22:53 2022] DELETE /identity/v3/users/39d46455057f421cad564862f7199875 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:55.353896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e3f5-6f79-4cfa-b62d-e9599c1a607d None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.354438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e3f5-6f79-4cfa-b62d-e9599c1a607d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.354438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e3f5-6f79-4cfa-b62d-e9599c1a607d None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.355925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 829/1653] 10.222.0.71 () {54 vars in 962 bytes} [Tue Aug 2 09:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:22:55.365311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a78e7-851c-4a00-b0ca-c6ddaf1e7a38 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.366417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a78e7-851c-4a00-b0ca-c6ddaf1e7a38 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.366842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a78e7-851c-4a00-b0ca-c6ddaf1e7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.396708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0d9a78e7-851c-4a00-b0ca-c6ddaf1e7a38 None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:55.398942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d9a78e7-851c-4a00-b0ca-c6ddaf1e7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:55.490520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 825/1654] 10.222.0.71 () {58 vars in 1059 bytes} [Tue Aug 2 09:22:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:55.495291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a1af-c4db-40b6-9952-cff1c575b2bb None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.500091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a1af-c4db-40b6-9952-cff1c575b2bb None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.500091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a1af-c4db-40b6-9952-cff1c575b2bb None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.500091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 830/1655] 10.222.0.71 () {54 vars in 912 bytes} [Tue Aug 2 09:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:22:55.509206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.509206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.509206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.519925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295783b-f732-418e-b67a-26aca6e3bb0c None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.529135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295783b-f732-418e-b67a-26aca6e3bb0c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.529135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295783b-f732-418e-b67a-26aca6e3bb0c None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.529135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 831/1656] 10.222.0.71 () {54 vars in 921 bytes} [Tue Aug 2 09:22:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:22:55.541582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:55.547186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f82b2-305e-486a-8be1-09b3d8465e8d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.547820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f82b2-305e-486a-8be1-09b3d8465e8d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.548254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f82b2-305e-486a-8be1-09b3d8465e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.548890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:55.561079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 826/1657] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:22:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:22:55.580599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:55.586353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:55.595841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-444f82b2-305e-486a-8be1-09b3d8465e8d None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:55.606342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-444f82b2-305e-486a-8be1-09b3d8465e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:55.695229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:55.709284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac2b5-50c6-4761-8f8f-a55c4b3ba08a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:55.717490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a99b2-97be-40e0-9bb2-f52ab14188ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:55.718172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a99b2-97be-40e0-9bb2-f52ab14188ae service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.718456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a99b2-97be-40e0-9bb2-f52ab14188ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.718963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a99b2-97be-40e0-9bb2-f52ab14188ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.749875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a99b2-97be-40e0-9bb2-f52ab14188ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:55.754141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a99b2-97be-40e0-9bb2-f52ab14188ae service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:55.775272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 832/1658] 10.222.0.71 () {58 vars in 1018 bytes} [Tue Aug 2 09:22:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:55.779190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 827/1659] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:22:55.897936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e7731-75c0-4be9-8e9a-62f8c2abe39b None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.899455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e7731-75c0-4be9-8e9a-62f8c2abe39b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.899961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e7731-75c0-4be9-8e9a-62f8c2abe39b None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.901631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 833/1660] 10.222.0.71 () {54 vars in 961 bytes} [Tue Aug 2 09:22:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:22:55.909251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:55.909766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:55.910164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:55.975213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:55.976769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:55.998614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 828/1661] 10.222.0.71 () {58 vars in 1058 bytes} [Tue Aug 2 09:22:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:56.010628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e7731-75c0-4be9-8e9a-62f8c2abe39b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:56.039052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e7731-75c0-4be9-8e9a-62f8c2abe39b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:56.059201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145fcd2-1f7e-4b59-a2fe-c458b1f5dba3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41aaa2d337974ae29ef28b1126e70435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:56.060929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145fcd2-1f7e-4b59-a2fe-c458b1f5dba3 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:56.064079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145fcd2-1f7e-4b59-a2fe-c458b1f5dba3 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:56.064656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145fcd2-1f7e-4b59-a2fe-c458b1f5dba3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:56.090701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145fcd2-1f7e-4b59-a2fe-c458b1f5dba3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:56.092797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145fcd2-1f7e-4b59-a2fe-c458b1f5dba3 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:56.124884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 834/1662] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:22:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:22:56.564462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:56.565778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:56.788533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580471-00b8-4b13-8844-7d815cd138bc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:56.803637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:56.804334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:56.804623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:56.804905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] PATH_INFO: `/v3/projects/b91d3ac193674c578d8746a8e03caecf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:56.812042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91d3ac193674c578d8746a8e03caecf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:56.824300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:57.058449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91d3ac193674c578d8746a8e03caecf', 'request_id': 'req-efc66f27-6b58-44c0-bbac-ec2838e85362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:57.077585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91d3ac193674c578d8746a8e03caecf', 'request_id': 'req-efc66f27-6b58-44c0-bbac-ec2838e85362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:57.258626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91d3ac193674c578d8746a8e03caecf', 'request_id': 'req-efc66f27-6b58-44c0-bbac-ec2838e85362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:57.278658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] The token cache is being invalidate because project b91d3ac193674c578d8746a8e03caecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:22:57.279259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:57.280428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-efc66f27-6b58-44c0-bbac-ec2838e85362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:57.282803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 829/1663] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:22:56 2022] DELETE /identity/v3/projects/b91d3ac193674c578d8746a8e03caecf => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:57.288774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994f5c7-92b0-44d7-9381-ab3f69018992 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:57.289275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994f5c7-92b0-44d7-9381-ab3f69018992 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:57.289558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994f5c7-92b0-44d7-9381-ab3f69018992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:57.335045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1994f5c7-92b0-44d7-9381-ab3f69018992 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:57.343179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1994f5c7-92b0-44d7-9381-ab3f69018992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:57.505998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 835/1664] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:57.506536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3241cc-952d-4ccd-8501-e608e57bd8ef None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:57.506763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3241cc-952d-4ccd-8501-e608e57bd8ef None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:57.507042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3241cc-952d-4ccd-8501-e608e57bd8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:57.543265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ff3241cc-952d-4ccd-8501-e608e57bd8ef None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:57.544634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ff3241cc-952d-4ccd-8501-e608e57bd8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:57.569683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 830/1665] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:22:57.572684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994f5c7-92b0-44d7-9381-ab3f69018992 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:57.591490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994f5c7-92b0-44d7-9381-ab3f69018992 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:57.604481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:57.611149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:57.611149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:57.611149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:57.611149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:22:57.611149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:57.611149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:57.635337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3241cc-952d-4ccd-8501-e608e57bd8ef None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:57.641610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 836/1666] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:22:57.655754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3241cc-952d-4ccd-8501-e608e57bd8ef None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:57.667353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:57.667997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:57.668278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:57.668557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:57.669239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:57.671410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:57.829449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 831/1667] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:57 2022] POST /identity/v3/projects => generated 363 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:57.835595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:57.843813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:57.856935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594915c-797d-4297-b593-776dcfdf5b63 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:58.038715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:58.038715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:58.038715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:58.038715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:58.039268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:58.039268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:58.164182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 837/1668] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:57 2022] POST /identity/v3/users => generated 282 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:22:58.167273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:58.203675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e47ac-6e69-490e-a007-31c9155eb9e7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:58.217601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:58.219787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:58.221144 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:58.222855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:58.224627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:58.243818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:58.284126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 832/1669] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:58.287667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:58.302082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1515d-053c-45fb-a592-ff5a634e8c41 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:58.317147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:58.317812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:58.318107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:58.318386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:58.322690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:58.322690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:58.357558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:58.368300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 838/1670] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:58.374177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df812bc3-b186-44c3-875d-8bf7f8fe0e9b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:58.403653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6381c-349d-40df-b19e-f35cdbb97517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:58.408058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6381c-349d-40df-b19e-f35cdbb97517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:58.408058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6381c-349d-40df-b19e-f35cdbb97517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:58.408058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6381c-349d-40df-b19e-f35cdbb97517 admin admin] PATH_INFO: `/v3/projects/871a2e091b214ef8bec784ec28f253e8/users/4a6f550404664f0e890ea06f9ca2b8f0/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:58.449361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6381c-349d-40df-b19e-f35cdbb97517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871a2e091b214ef8bec784ec28f253e8, user_id=4a6f550404664f0e890ea06f9ca2b8f0, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:58.453309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6381c-349d-40df-b19e-f35cdbb97517 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:58.503165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:58.505005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:58.524406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021457f7-1be8-4e4d-9934-a1153ac82c85 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:58.539798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:58.540734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:58.541245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:58.542156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] PATH_INFO: `/v3/users/31bbdf48394f41f7945ae4affb13a6be` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:58.545140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bbdf48394f41f7945ae4affb13a6be)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:58.547301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:58.602665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 833/1671] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:58 2022] PUT /identity/v3/projects/871a2e091b214ef8bec784ec28f253e8/users/4a6f550404664f0e890ea06f9ca2b8f0/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:58.613646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707d75c-4e0e-4a8c-be30-f419360524ee None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:58.617896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707d75c-4e0e-4a8c-be30-f419360524ee None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:58.617896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707d75c-4e0e-4a8c-be30-f419360524ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:58.662919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:58.677364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3707d75c-4e0e-4a8c-be30-f419360524ee None None] MFA Rules not processed for user `4a6f550404664f0e890ea06f9ca2b8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:22:58.678944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3707d75c-4e0e-4a8c-be30-f419360524ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:58.799104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 834/1672] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:22:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:22:58.810197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707d75c-4e0e-4a8c-be30-f419360524ee None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:58.826826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bbdf48394f41f7945ae4affb13a6be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:58.826826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bbdf48394f41f7945ae4affb13a6be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:58.850176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bbdf48394f41f7945ae4affb13a6be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:58.961499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bbdf48394f41f7945ae4affb13a6be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:58.962214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bbdf48394f41f7945ae4affb13a6be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:22:58.967101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707d75c-4e0e-4a8c-be30-f419360524ee None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:58.976508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:58.976508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:58.976508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:58.977027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:58.978032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:58.980447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:58.981536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 839/1673] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:22:58 2022] DELETE /identity/v3/users/31bbdf48394f41f7945ae4affb13a6be => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:22:59.127851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 835/1674] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:22:58 2022] POST /identity/v3/projects => generated 363 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:59.131230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:59.132727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:22:59.290935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956a99-f447-49b4-8a6a-117a78f33046 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:59.585841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:59.586600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:59.593282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:59.598042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:59.598042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:59.615337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:59.668744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:59.807788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 840/1675] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:22:59 2022] POST /identity/v3/users => generated 288 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:22:59.812456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:59.866720 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8cfbc-c3a5-450f-ba43-bf5e0d434425 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:59.869164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:59.870911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:59.870911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:59.870911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:59.872668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:59.874566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:22:59.892999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 836/1676] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:22:59.896647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:22:59.913407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc9850-5f2b-4b4e-98dc-a4ab414b4d2a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:22:59.926979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:22:59.927664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:22:59.928126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:22:59.928551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] PATH_INFO: `/v3/projects/a314c051a9ff45e7925327031e9bcf5a/users/b7995aab162740e4939630483296ee28/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:22:59.959137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a314c051a9ff45e7925327031e9bcf5a, user_id=b7995aab162740e4939630483296ee28, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:22:59.972661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:00.111991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 841/1677] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:22:59 2022] PUT /identity/v3/projects/a314c051a9ff45e7925327031e9bcf5a/users/b7995aab162740e4939630483296ee28/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:00.114626 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:00.128157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411fe6c-4396-4bd8-8ce1-fc36806d7c87 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:00.294586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78198e7e-837e-4cd8-be15-e49eb782ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:00.295080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78198e7e-837e-4cd8-be15-e49eb782ead6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:00.295372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78198e7e-837e-4cd8-be15-e49eb782ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:00.295653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78198e7e-837e-4cd8-be15-e49eb782ead6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:00.296363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78198e7e-837e-4cd8-be15-e49eb782ead6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:00.306899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78198e7e-837e-4cd8-be15-e49eb782ead6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:00.321894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 837/1678] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:00.331925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:00.348819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e772-70f1-492e-aa27-64914c23bc37 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:00.354912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:00.355056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:00.355300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:00.355819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] PATH_INFO: `/v3/projects/a314c051a9ff45e7925327031e9bcf5a/users/b7995aab162740e4939630483296ee28/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:00.358228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a314c051a9ff45e7925327031e9bcf5a, user_id=b7995aab162740e4939630483296ee28, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:00.362438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:00.381656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 842/1679] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:00 2022] PUT /identity/v3/projects/a314c051a9ff45e7925327031e9bcf5a/users/b7995aab162740e4939630483296ee28/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:00.392495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:00.394943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:00.394943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:00.483723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] MFA Rules not processed for user `b7995aab162740e4939630483296ee28`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:00.485708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:00.564018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:00.567121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:00.691751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 838/1680] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:00.713475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:00.715048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:00.740932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78174-0e71-4223-976f-ddaf931c3857 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:00.753755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:00.757376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:00.758084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:00.758387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:00.758673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] PATH_INFO: `/v3/projects/9676be4fe3c94ab6805dc5dd92ff677e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:00.759921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9676be4fe3c94ab6805dc5dd92ff677e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:00.761925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:00.818267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a031fc-5201-434f-88a1-794963d0f047 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:00.822700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:00.823955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:00.826986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:00.826986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:00.853617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:00.855540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:00.881443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 839/1681] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:23:00.927684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9676be4fe3c94ab6805dc5dd92ff677e', 'request_id': 'req-761ac278-249c-40b0-8927-2f74f6935103'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:00.943223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9676be4fe3c94ab6805dc5dd92ff677e', 'request_id': 'req-761ac278-249c-40b0-8927-2f74f6935103'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:00.954977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9676be4fe3c94ab6805dc5dd92ff677e', 'request_id': 'req-761ac278-249c-40b0-8927-2f74f6935103'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.120362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] The token cache is being invalidate because project 9676be4fe3c94ab6805dc5dd92ff677e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:01.120659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.124985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-761ac278-249c-40b0-8927-2f74f6935103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.128327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 843/1682] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:00 2022] DELETE /identity/v3/projects/9676be4fe3c94ab6805dc5dd92ff677e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:01.132036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:01.155967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa19d9-49fd-4653-8ec8-5f8931acbf12 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:01.325224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:01.326032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:01.332294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:01.332294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] PATH_INFO: `/v3/users/39daeadb097b4d47a41f8e68bff20a28` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:01.332294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39daeadb097b4d47a41f8e68bff20a28)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:01.335276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:01.680661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39daeadb097b4d47a41f8e68bff20a28'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.682107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39daeadb097b4d47a41f8e68bff20a28'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.726562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39daeadb097b4d47a41f8e68bff20a28'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.738604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39daeadb097b4d47a41f8e68bff20a28'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.807547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39daeadb097b4d47a41f8e68bff20a28'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:01.822138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 840/1683] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:01 2022] DELETE /identity/v3/users/39daeadb097b4d47a41f8e68bff20a28 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:02.397837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:02.925583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:02.925583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:02.925583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:02.978736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] MFA Rules not processed for user `19e502fd45f34837bcf2caff0a82a668`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:02.980119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:03.041948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:03.049775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:03.051784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:03.174442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 844/1684] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:03.185100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:03.187220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:03.311230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b907c3f-090a-41e6-9027-6cab9d9381d8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:03.367875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:03.369068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:03.369900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:03.370744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] PATH_INFO: `/v3/users/4a6f550404664f0e890ea06f9ca2b8f0` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:03.373610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6f550404664f0e890ea06f9ca2b8f0)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:03.376419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:03.405039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f85e61-4a1b-4702-91e0-458eb5cae819 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:03.423992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a16531-7bf7-45f5-a57a-ce22de8d7e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:03.425103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16531-7bf7-45f5-a57a-ce22de8d7e63 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:03.425597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16531-7bf7-45f5-a57a-ce22de8d7e63 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:03.426090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16531-7bf7-45f5-a57a-ce22de8d7e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:03.450399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a16531-7bf7-45f5-a57a-ce22de8d7e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:03.456692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a16531-7bf7-45f5-a57a-ce22de8d7e63 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:03.489989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 845/1685] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:23:03.687501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6f550404664f0e890ea06f9ca2b8f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:03.688301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6f550404664f0e890ea06f9ca2b8f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:03.724749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6f550404664f0e890ea06f9ca2b8f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:03.750823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6f550404664f0e890ea06f9ca2b8f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:03.898810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-24b1796d-24da-4339-8417-a648c8d62d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6f550404664f0e890ea06f9ca2b8f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:03.917181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 841/1686] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:03 2022] DELETE /identity/v3/users/4a6f550404664f0e890ea06f9ca2b8f0 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:03.922626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:03.923343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:03.923943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:03.993153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:03.995119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:03.995555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:03.996076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:04.005483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.065985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] MFA Rules not processed for user `f6d86c4ecd7e4681b8942837246ecefa`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:04.067430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.155446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 846/1687] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:04.157543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:04.163558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.227882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f5a6-cbb2-4484-9b02-d718600204bc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:04.248736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:04.249410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:04.249700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:04.258056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] PATH_INFO: `/v3/projects/6f7de9b6ea5640b9aff40616b9a29f11` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:04.258056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7de9b6ea5640b9aff40616b9a29f11)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:04.264502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 842/1688] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:04.265990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:04.268994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.270653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:04.380704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e124e-5233-40c9-bfd2-eacf91eb5acd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:04.396089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457ebd-80cf-4f01-98fd-601dcacf8780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:04.397004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457ebd-80cf-4f01-98fd-601dcacf8780 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:04.397436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457ebd-80cf-4f01-98fd-601dcacf8780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:04.397896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457ebd-80cf-4f01-98fd-601dcacf8780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:04.422687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19457ebd-80cf-4f01-98fd-601dcacf8780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:04.424200 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19457ebd-80cf-4f01-98fd-601dcacf8780 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:04.455683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 843/1689] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:04.459523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:04.459876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:04.460315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:04.504754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] MFA Rules not processed for user `f6d86c4ecd7e4681b8942837246ecefa`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:04.508193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.535494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 844/1690] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:04.545594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:04.547356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.575597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7de9b6ea5640b9aff40616b9a29f11', 'request_id': 'req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:04.594563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7de9b6ea5640b9aff40616b9a29f11', 'request_id': 'req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:04.612180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7de9b6ea5640b9aff40616b9a29f11', 'request_id': 'req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:04.643164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:04.712259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] The token cache is being invalidate because project 6f7de9b6ea5640b9aff40616b9a29f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:04.712561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:04.713541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6b9382f5-06e4-4bc6-99d5-d0de3d65ca47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:04.716812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 847/1691] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:04 2022] DELETE /identity/v3/projects/6f7de9b6ea5640b9aff40616b9a29f11 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:04.725332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:04.725893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:04.726335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:04.776317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cfc1e-724a-48b1-a726-4148bb70c11e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:04.806655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:04.809899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.921489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 848/1692] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:04.922909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:04.924823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.935706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0d6b6-8615-44bc-8c6b-d79c7d2e35c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:04.935906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d6b6-8615-44bc-8c6b-d79c7d2e35c7 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:04.936153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d6b6-8615-44bc-8c6b-d79c7d2e35c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:04.936431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d6b6-8615-44bc-8c6b-d79c7d2e35c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:04.946285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5cb0d6b6-8615-44bc-8c6b-d79c7d2e35c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:04.963491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f659ee-43f2-464f-b5c7-3edd9cad7b0d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:04.976782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:04.978732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:04.979369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:04.979858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] PATH_INFO: `/v3/users/a4a288300a2e4a769073048170a7f673` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:04.981372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a288300a2e4a769073048170a7f673)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:04.984229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:05.084536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0d6b6-8615-44bc-8c6b-d79c7d2e35c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:05.086763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0d6b6-8615-44bc-8c6b-d79c7d2e35c7 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:05.108379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 845/1693] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:23:05.109620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0208-0c86-4cdc-bc1b-8a533a4b93b7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:05.110106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0208-0c86-4cdc-bc1b-8a533a4b93b7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:05.110631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0208-0c86-4cdc-bc1b-8a533a4b93b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:05.158322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-892d0208-0c86-4cdc-bc1b-8a533a4b93b7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:05.160142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-892d0208-0c86-4cdc-bc1b-8a533a4b93b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:05.179688 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:05.185003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 846/1694] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:05.186077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d0208-0c86-4cdc-bc1b-8a533a4b93b7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:05.207623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d0208-0c86-4cdc-bc1b-8a533a4b93b7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:05.225559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:05.226238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:05.226518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:05.226943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:05.227813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:05.228279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:05.230101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:05.248827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a288300a2e4a769073048170a7f673'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:05.252197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a288300a2e4a769073048170a7f673'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:05.275360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 847/1695] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:23:05.276365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:05.290371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a288300a2e4a769073048170a7f673'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:05.296421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0267-93e4-487d-bcdf-4f2c5f80dd6a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:05.314154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:05.314820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:05.315089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:05.315531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:05.316355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:05.318704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:05.430419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a288300a2e4a769073048170a7f673'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:05.433947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44243358-6b86-4079-9ebf-dfdcffb6edc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a288300a2e4a769073048170a7f673'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:05.463977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 849/1696] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:04 2022] DELETE /identity/v3/users/a4a288300a2e4a769073048170a7f673 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:05.468263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:05.477791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:05.477791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:05.478011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 848/1697] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:05 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:05.478698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:05.480557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:05.505639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:05.507766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:05.619275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31fba7-2f4d-4515-9746-7680f370d772 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:05.630941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 850/1698] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:05.633690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6421b4-3411-40d0-8566-95ac09a4c5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:05.634517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6421b4-3411-40d0-8566-95ac09a4c5ae admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:05.635165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6421b4-3411-40d0-8566-95ac09a4c5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:05.635738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6421b4-3411-40d0-8566-95ac09a4c5ae admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:05.636951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6421b4-3411-40d0-8566-95ac09a4c5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:05.639048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6421b4-3411-40d0-8566-95ac09a4c5ae admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:05.700494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:05.702125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:05.778913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 849/1699] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:05 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:05.788499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37143b-93d0-4ceb-8632-132aefd2a50b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:05.792689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37143b-93d0-4ceb-8632-132aefd2a50b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:05.793017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37143b-93d0-4ceb-8632-132aefd2a50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:05.870642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3b37143b-93d0-4ceb-8632-132aefd2a50b None None] MFA Rules not processed for user `e88b4253cdef44f0a1f0a5ca2b5733dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:05.872449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3b37143b-93d0-4ceb-8632-132aefd2a50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:05.997401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f600eb-768c-442c-902a-34efc8ce6fdd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:06.004165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2922f-72c5-4e75-befc-9d8b1b55b77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:06.005470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2922f-72c5-4e75-befc-9d8b1b55b77a service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.006096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2922f-72c5-4e75-befc-9d8b1b55b77a service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.006582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2922f-72c5-4e75-befc-9d8b1b55b77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.008272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 850/1700] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:06.009249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37143b-93d0-4ceb-8632-132aefd2a50b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:06.027457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37143b-93d0-4ceb-8632-132aefd2a50b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:06.029540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2922f-72c5-4e75-befc-9d8b1b55b77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:06.031408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2922f-72c5-4e75-befc-9d8b1b55b77a service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:06.035877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:06.037809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.038113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.041370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.042344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:06.044140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:06.059261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 851/1701] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:06.061027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:06.065290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:06.078727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 851/1702] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:06.084753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36a9f-e27f-4b2b-84d6-c030181d2f9d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:06.090323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b0f4-4bf9-49b6-99d8-8c2d49e87e05 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.090626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b0f4-4bf9-49b6-99d8-8c2d49e87e05 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.090912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b0f4-4bf9-49b6-99d8-8c2d49e87e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.092411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:06.093209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.093493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.094231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] PATH_INFO: `/v3/projects/871a2e091b214ef8bec784ec28f253e8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.096872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=871a2e091b214ef8bec784ec28f253e8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:06.101768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:06.169667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c480b0f4-4bf9-49b6-99d8-8c2d49e87e05 None None] MFA Rules not processed for user `e88b4253cdef44f0a1f0a5ca2b5733dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:06.171000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c480b0f4-4bf9-49b6-99d8-8c2d49e87e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:06.192830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 852/1703] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:06.192830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b0f4-4bf9-49b6-99d8-8c2d49e87e05 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:06.213144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b0f4-4bf9-49b6-99d8-8c2d49e87e05 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:06.227488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:06.227488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.227488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.227488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.228057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:06.232336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:06.254903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 853/1704] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:06.262634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:06.262634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:06.333847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871a2e091b214ef8bec784ec28f253e8', 'request_id': 'req-d680fb84-2840-493b-8d7d-c95f674fbde0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:06.333847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871a2e091b214ef8bec784ec28f253e8', 'request_id': 'req-d680fb84-2840-493b-8d7d-c95f674fbde0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:06.422444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92e5ad-ed71-4b07-97c2-929496b077db admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:06.430532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871a2e091b214ef8bec784ec28f253e8', 'request_id': 'req-d680fb84-2840-493b-8d7d-c95f674fbde0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:06.454124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] The token cache is being invalidate because project 871a2e091b214ef8bec784ec28f253e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:06.456943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:06.458100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:06.462878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 852/1705] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:06 2022] DELETE /identity/v3/projects/871a2e091b214ef8bec784ec28f253e8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:06.463835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:06.467694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:06.607454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1160dc-bdc9-4e11-9a6a-f0599f48947a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:06.608358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1160dc-bdc9-4e11-9a6a-f0599f48947a service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.608808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1160dc-bdc9-4e11-9a6a-f0599f48947a service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.609240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1160dc-bdc9-4e11-9a6a-f0599f48947a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.616365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ff1160dc-bdc9-4e11-9a6a-f0599f48947a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:06.637824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680fb84-2840-493b-8d7d-c95f674fbde0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:06.650409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7bc39-d828-4546-93b9-fa895481c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:06.669924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7bc39-d828-4546-93b9-fa895481c79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.670335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7bc39-d828-4546-93b9-fa895481c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.670785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7bc39-d828-4546-93b9-fa895481c79f admin admin] PATH_INFO: `/v3/projects/b6a07765cc494ad69b54fb99dade49c5/users/473198f912004acaabec7d9cda74c472/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.724744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7bc39-d828-4546-93b9-fa895481c79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a07765cc494ad69b54fb99dade49c5, user_id=473198f912004acaabec7d9cda74c472, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:06.732905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7bc39-d828-4546-93b9-fa895481c79f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:06.829532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1160dc-bdc9-4e11-9a6a-f0599f48947a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:06.831186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1160dc-bdc9-4e11-9a6a-f0599f48947a service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:06.857864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 854/1706] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:06.859386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dcb13-d469-4249-bd61-6de6d65d3e90 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.865780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dcb13-d469-4249-bd61-6de6d65d3e90 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.865780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dcb13-d469-4249-bd61-6de6d65d3e90 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:06.868036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 855/1707] 10.222.0.71 () {54 vars in 912 bytes} [Tue Aug 2 09:23:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:23:06.871322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dcb13-d469-4249-bd61-6de6d65d3e90 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:06.879030 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-745dcb13-d469-4249-bd61-6de6d65d3e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:06.892735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 853/1708] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:06 2022] PUT /identity/v3/projects/b6a07765cc494ad69b54fb99dade49c5/users/473198f912004acaabec7d9cda74c472/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:06.897604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e6dd-9258-4d28-960b-59b71ef763fe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:06.898890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e6dd-9258-4d28-960b-59b71ef763fe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:06.899326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e6dd-9258-4d28-960b-59b71ef763fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e419e6dd-9258-4d28-960b-59b71ef763fe None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:07.022149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:07.022969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:23:07.044278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 854/1709] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:06 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 150 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:07.045916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e02c9-0a55-4cdf-808d-accf708c084b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:07.051124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e02c9-0a55-4cdf-808d-accf708c084b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:07.051831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e02c9-0a55-4cdf-808d-accf708c084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:07.198034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d84e02c9-0a55-4cdf-808d-accf708c084b None None] MFA Rules not processed for user `473198f912004acaabec7d9cda74c472`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:07.199314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d84e02c9-0a55-4cdf-808d-accf708c084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:07.206468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dcb13-d469-4249-bd61-6de6d65d3e90 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:07.218162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:07.220609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:07.222239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:07.227588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:07.228419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] PATH_INFO: `/v3/users/b7995aab162740e4939630483296ee28` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:07.230202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7995aab162740e4939630483296ee28)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:07.232579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:07.456014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 855/1710] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:07.460790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e02c9-0a55-4cdf-808d-accf708c084b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:07.483601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e02c9-0a55-4cdf-808d-accf708c084b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:07.505107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:07.505812 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:07.506070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:07.506395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:07.507083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:07.509096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:07.557125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:07.574603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7995aab162740e4939630483296ee28'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:07.577643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7995aab162740e4939630483296ee28'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:07.609496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7995aab162740e4939630483296ee28'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:07.671132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 856/1711] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:07 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:23:07.676634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:07.716099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7995aab162740e4939630483296ee28'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:07.716988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7995aab162740e4939630483296ee28'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:07.754739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 856/1712] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:06 2022] DELETE /identity/v3/users/b7995aab162740e4939630483296ee28 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:07.777017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:07.822301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994f14e-4765-4cb9-aa65-201ee4d01ad7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:07.945836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:07.946629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:07.947013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:07.947406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:07.948651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:07.963705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:08.099372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 857/1713] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:07 2022] POST /identity/v3/users => generated 293 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:08.104344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:08.105243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:08.131489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1d963-aa3d-44dc-a467-27e797055704 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:08.144561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:08.145535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:08.146005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:08.147170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:08.148059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:08.154165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:08.180831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 857/1714] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:08.182737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:08.197657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e1bc-2856-49ba-be2b-95700a4818c2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:08.227448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:08.228162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:08.228455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:08.234395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] PATH_INFO: `/v3/projects/806cd362a77a4b069ec0b57a32c957cf/users/56298ec05b3243a08e0d4df2484fbcc8/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:08.280871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806cd362a77a4b069ec0b57a32c957cf, user_id=56298ec05b3243a08e0d4df2484fbcc8, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:08.296857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:08.395932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 858/1715] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:08 2022] PUT /identity/v3/projects/806cd362a77a4b069ec0b57a32c957cf/users/56298ec05b3243a08e0d4df2484fbcc8/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:08.400171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:08.421580 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb94a0c-f6be-43ae-8f5c-a81f52cb5eaf admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:08.507958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:08.508178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:08.647117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb9e9-e38b-4a67-8798-5c00afaf6392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:08.653119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb9e9-e38b-4a67-8798-5c00afaf6392 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:08.653119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb9e9-e38b-4a67-8798-5c00afaf6392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:08.653119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb9e9-e38b-4a67-8798-5c00afaf6392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:08.653119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb9e9-e38b-4a67-8798-5c00afaf6392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:08.653119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb9e9-e38b-4a67-8798-5c00afaf6392 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:08.680615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 858/1716] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:08.680615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574651b4-87cb-4d59-8d3c-60877fc0619f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:08.684534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574651b4-87cb-4d59-8d3c-60877fc0619f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:08.684534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574651b4-87cb-4d59-8d3c-60877fc0619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:08.734718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1cdd4-1d0d-4a33-b15a-e50acd540de5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:08.747413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-574651b4-87cb-4d59-8d3c-60877fc0619f None None] MFA Rules not processed for user `f5a85438fda6446fa7d9b31da11d539b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:08.749481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-574651b4-87cb-4d59-8d3c-60877fc0619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:08.751940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:08.752925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:08.754534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:08.756620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] PATH_INFO: `/v3/projects/d82ab6fda9db43edaa1a5b25d9f34bec` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:08.758910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82ab6fda9db43edaa1a5b25d9f34bec)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:08.767024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:08.947267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 859/1717] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:08.948215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574651b4-87cb-4d59-8d3c-60877fc0619f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:08.992682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574651b4-87cb-4d59-8d3c-60877fc0619f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:09.058449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82ab6fda9db43edaa1a5b25d9f34bec', 'request_id': 'req-56641c08-7a35-4074-8e3e-58905636a1eb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:09.078874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82ab6fda9db43edaa1a5b25d9f34bec', 'request_id': 'req-56641c08-7a35-4074-8e3e-58905636a1eb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:09.120069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adb3c7-9e15-4755-a3ee-68ebbcd5cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:09.120907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb3c7-9e15-4755-a3ee-68ebbcd5cea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.121414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb3c7-9e15-4755-a3ee-68ebbcd5cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.121949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb3c7-9e15-4755-a3ee-68ebbcd5cea7 admin admin] PATH_INFO: `/v3/projects/806cd362a77a4b069ec0b57a32c957cf/users/56298ec05b3243a08e0d4df2484fbcc8/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.126558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adb3c7-9e15-4755-a3ee-68ebbcd5cea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806cd362a77a4b069ec0b57a32c957cf, user_id=56298ec05b3243a08e0d4df2484fbcc8, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:09.128910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82ab6fda9db43edaa1a5b25d9f34bec', 'request_id': 'req-56641c08-7a35-4074-8e3e-58905636a1eb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:09.136029 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adb3c7-9e15-4755-a3ee-68ebbcd5cea7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:09.142930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] The token cache is being invalidate because project d82ab6fda9db43edaa1a5b25d9f34bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:09.143506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:09.144423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-56641c08-7a35-4074-8e3e-58905636a1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:09.147013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 859/1718] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:08 2022] DELETE /identity/v3/projects/d82ab6fda9db43edaa1a5b25d9f34bec => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:09.150127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7668c-4e8c-48eb-b506-b0652c09f40a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.150671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7668c-4e8c-48eb-b506-b0652c09f40a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.151347 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7668c-4e8c-48eb-b506-b0652c09f40a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.153574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 860/1719] 10.222.0.71 () {54 vars in 912 bytes} [Tue Aug 2 09:23:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:23:09.154602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7668c-4e8c-48eb-b506-b0652c09f40a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:09.156681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-71f7668c-4e8c-48eb-b506-b0652c09f40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:09.167905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 860/1720] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:08 2022] PUT /identity/v3/projects/806cd362a77a4b069ec0b57a32c957cf/users/56298ec05b3243a08e0d4df2484fbcc8/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:09.173331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9f06-7f8b-4404-af02-fc8735a04aa6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.173781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9f06-7f8b-4404-af02-fc8735a04aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.173996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9f06-7f8b-4404-af02-fc8735a04aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.216918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d93e9f06-7f8b-4404-af02-fc8735a04aa6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:09.218364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d93e9f06-7f8b-4404-af02-fc8735a04aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:09.294274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7668c-4e8c-48eb-b506-b0652c09f40a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:09.306869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5f4f1-882a-4e94-909e-47e52d698a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:09.308647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5f4f1-882a-4e94-909e-47e52d698a79 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.310558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 861/1721] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:09.310809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5f4f1-882a-4e94-909e-47e52d698a79 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.311316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5f4f1-882a-4e94-909e-47e52d698a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.313572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f928-94eb-4600-a6c8-f84d7e1af846 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.315114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f928-94eb-4600-a6c8-f84d7e1af846 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.316387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bfe5f4f1-882a-4e94-909e-47e52d698a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:09.318128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f928-94eb-4600-a6c8-f84d7e1af846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-8110f928-94eb-4600-a6c8-f84d7e1af846 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:09.340742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:09.341673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:23:09.345693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 862/1722] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:09.350490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb6c24-ff7f-4fde-8d49-9d3061bdea25 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.352322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb6c24-ff7f-4fde-8d49-9d3061bdea25 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.352895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb6c24-ff7f-4fde-8d49-9d3061bdea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.428038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a0fb6c24-ff7f-4fde-8d49-9d3061bdea25 None None] MFA Rules not processed for user `56298ec05b3243a08e0d4df2484fbcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:09.433777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a0fb6c24-ff7f-4fde-8d49-9d3061bdea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:09.471741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5f4f1-882a-4e94-909e-47e52d698a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:09.473751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5f4f1-882a-4e94-909e-47e52d698a79 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:09.497869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 861/1723] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:09.499378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ac73d-4d66-4236-b0d3-d164d45ed4b1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.500384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ac73d-4d66-4236-b0d3-d164d45ed4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.500683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ac73d-4d66-4236-b0d3-d164d45ed4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.551924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-023ac73d-4d66-4236-b0d3-d164d45ed4b1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:09.553596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-023ac73d-4d66-4236-b0d3-d164d45ed4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:09.570948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:09.577552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 862/1724] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:09.577866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.578167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.578460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.629709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] MFA Rules not processed for user `19e502fd45f34837bcf2caff0a82a668`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:09.630985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:09.706919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 863/1725] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:09.706919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb6c24-ff7f-4fde-8d49-9d3061bdea25 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:09.733370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb6c24-ff7f-4fde-8d49-9d3061bdea25 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:09.744196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:09.744711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.746289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.746289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.746923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:09.747234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:09.752943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:09.770951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 863/1726] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:09.772042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:09.773910 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:09.806479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 864/1727] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:09.812691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:09.818478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:09.833369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc265d-3c9b-48f0-a618-868a65b5d45d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:09.839360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:09.840039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.840325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.840606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.841322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:09.843726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:09.936994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25d3a6-f3c1-4372-b513-128194df2c4d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:09.942475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:09.943376 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:09.943747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:09.944229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:09.958148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:09.960536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:09.978551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 865/1729] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:09 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:09.982698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 864/1729] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:09.982849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:10.099769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc631e2f-a157-4add-a020-dc4daf929158 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:10.114568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:10.115296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.117754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.118068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.119027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:10.126854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:10.151690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:10.154081 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:10.176818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6dd39-fcf4-4418-8c29-582efded2d19 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:10.184304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:10.185367 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.185935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.186432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] PATH_INFO: `/v3/projects/a314c051a9ff45e7925327031e9bcf5a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.189866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a314c051a9ff45e7925327031e9bcf5a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:10.192363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:10.236764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 866/1730] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:09 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:10.273803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:10.296706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc088ec-47c6-4a29-a246-c16b6b669b6e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:10.303621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:10.308045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.308045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.308045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.308045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:10.308045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:10.343939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 867/1731] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:10.345840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:10.359974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce35f99-e352-480b-80f5-152a41a017ce admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:10.373837 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:10.374482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.374766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.375213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.376660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:10.378454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:10.391173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 868/1732] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:10.396435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:10.408655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d579c-bbb2-4b52-ac5d-7f8af36ed77b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:10.421296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3d454-3529-4432-8d07-6837d06a3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:10.426066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d454-3529-4432-8d07-6837d06a3d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.428123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d454-3529-4432-8d07-6837d06a3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.429327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d454-3529-4432-8d07-6837d06a3d7e admin admin] PATH_INFO: `/v3/projects/27b2cae9214e4013869f83cd5b7422cf/users/052d1cd1d5e244c695f382053d9225a3/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.461453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a314c051a9ff45e7925327031e9bcf5a', 'request_id': 'req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:10.466441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:10.477293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a314c051a9ff45e7925327031e9bcf5a', 'request_id': 'req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:10.482633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3d454-3529-4432-8d07-6837d06a3d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b2cae9214e4013869f83cd5b7422cf, user_id=052d1cd1d5e244c695f382053d9225a3, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:10.505480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3d454-3529-4432-8d07-6837d06a3d7e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:10.580487 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a314c051a9ff45e7925327031e9bcf5a', 'request_id': 'req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:10.605122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 869/1733] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:10 2022] PUT /identity/v3/projects/27b2cae9214e4013869f83cd5b7422cf/users/052d1cd1d5e244c695f382053d9225a3/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:10.609744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.610044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.610940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.624295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] The token cache is being invalidate because project a314c051a9ff45e7925327031e9bcf5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:10.624631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:10.625711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7b63188-b9b8-46ef-a2c1-3aa27f9f755e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:10.633778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 865/1734] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:10 2022] DELETE /identity/v3/projects/a314c051a9ff45e7925327031e9bcf5a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:10.638641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce81ae-d337-4a2b-ae3d-9d5102fc2c76 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.638932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce81ae-d337-4a2b-ae3d-9d5102fc2c76 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.639278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce81ae-d337-4a2b-ae3d-9d5102fc2c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.722153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e0ce81ae-d337-4a2b-ae3d-9d5102fc2c76 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:10.725586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] MFA Rules not processed for user `052d1cd1d5e244c695f382053d9225a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:10.737062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e0ce81ae-d337-4a2b-ae3d-9d5102fc2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:10.738860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:10.838562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 866/1735] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:10.840827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606219-687f-4c47-b99d-691399d3b47c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.841309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606219-687f-4c47-b99d-691399d3b47c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.841687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606219-687f-4c47-b99d-691399d3b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:10.918479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1a606219-687f-4c47-b99d-691399d3b47c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:10.919802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a606219-687f-4c47-b99d-691399d3b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:10.953462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 867/1736] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:10.955301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a606219-687f-4c47-b99d-691399d3b47c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:10.971733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 870/1737] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:10.983047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:10.984642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a606219-687f-4c47-b99d-691399d3b47c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:10.985839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:10.998570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:10.999399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:10.999500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:10.999947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.000675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:11.001537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:11.013797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:11.057634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 868/1738] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:11.059677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:11.084719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02c5b-3ff8-438d-b931-9dc3331c8631 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:11.101676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:11.102752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.103032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.103317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.106377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:11.113174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:11.238428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925af967-c0ea-429b-83ed-3294aaa3d8d4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:11.244849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 869/1739] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:11 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:11.252396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:11.417701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:11.459748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce10ef-c3dd-47b8-be10-1d39a4b6692e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:11.460542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce10ef-c3dd-47b8-be10-1d39a4b6692e service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.460542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce10ef-c3dd-47b8-be10-1d39a4b6692e service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.460764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce10ef-c3dd-47b8-be10-1d39a4b6692e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.467093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4360ad-5136-4074-9618-336602dfb331 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:11.484412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:11.485506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.485811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.486870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.489322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:11.497453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:11.585817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce10ef-c3dd-47b8-be10-1d39a4b6692e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:11.588706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce10ef-c3dd-47b8-be10-1d39a4b6692e service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:11.601980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 871/1740] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:11.603562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5acd-430c-4273-862a-80a29b11f0bf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.604140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5acd-430c-4273-862a-80a29b11f0bf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.604519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e5acd-430c-4273-862a-80a29b11f0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-6c8e5acd-430c-4273-862a-80a29b11f0bf None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:11.612988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:11.614069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:23:11.616178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 872/1741] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:11.617410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e5acd-430c-4273-862a-80a29b11f0bf None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:11.627343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6c8e5acd-430c-4273-862a-80a29b11f0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:11.657951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 870/1742] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:11 2022] POST /identity/v3/users => generated 284 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:11.667019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:11.701032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b0de2-7839-4aef-9d9b-9e33bd4f6866 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:11.713066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:11.713445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e5acd-430c-4273-862a-80a29b11f0bf None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:11.723421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.723421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.723421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.723421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:11.724210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:11.724835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.725210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.725563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] PATH_INFO: `/v3/users/473198f912004acaabec7d9cda74c472` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.730102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473198f912004acaabec7d9cda74c472)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:11.731304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:11.732446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:11.781809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 871/1743] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:11.783345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:11.806705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fcbeb-2c9c-4f76-a2cd-7339896ccb79 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:11.810306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:11.811245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.811763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.814522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:11.815616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:11.819775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:11.859295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:11.912746 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 872/1744] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:11.921295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:11.951805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdedf-6beb-4f89-8bb8-060dc714c9bd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:11.962582 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:11.963130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:11.969100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:11.969461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] PATH_INFO: `/v3/projects/a582f71127dd4c10af7cee657bce321e/users/2ac65b2e498a4f829c8182977ce0545d/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:12.020279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a582f71127dd4c10af7cee657bce321e, user_id=2ac65b2e498a4f829c8182977ce0545d, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:12.051584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:12.064135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473198f912004acaabec7d9cda74c472'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.066213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473198f912004acaabec7d9cda74c472'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.090519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473198f912004acaabec7d9cda74c472'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.164965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 873/1745] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:11 2022] PUT /identity/v3/projects/a582f71127dd4c10af7cee657bce321e/users/2ac65b2e498a4f829c8182977ce0545d/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:12.166172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:12.170281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:12.207543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473198f912004acaabec7d9cda74c472'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.208386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c827dfe5-aadd-4a4e-a47a-d6438e825881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473198f912004acaabec7d9cda74c472'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.243313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 873/1746] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:11 2022] DELETE /identity/v3/users/473198f912004acaabec7d9cda74c472 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:12.246353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18dc04-a61b-460c-809c-aee67b196851 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:12.249636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18dc04-a61b-460c-809c-aee67b196851 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:12.250306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18dc04-a61b-460c-809c-aee67b196851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:12.306373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7097d6-42a0-4d04-a8c6-0c663a71604d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:12.334488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6a18dc04-a61b-460c-809c-aee67b196851 None None] MFA Rules not processed for user `2ac65b2e498a4f829c8182977ce0545d`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:12.343095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6a18dc04-a61b-460c-809c-aee67b196851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:12.432096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:12.435114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:12.435408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:12.437534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] PATH_INFO: `/v3/users/052d1cd1d5e244c695f382053d9225a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:12.446646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=052d1cd1d5e244c695f382053d9225a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:12.459608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:12.542657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 874/1747] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:12.544311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:12.544663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:12.544951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:12.585642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:12.587962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:12.613475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 875/1748] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:12.617529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:12.619363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:12.638994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed41ed-d403-4c82-a6a8-2bbef632da41 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:12.644763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:12.645521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:12.645868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:12.646150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:12.660330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:12.666849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:12.694864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052d1cd1d5e244c695f382053d9225a3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.695566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052d1cd1d5e244c695f382053d9225a3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.733334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052d1cd1d5e244c695f382053d9225a3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.749036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052d1cd1d5e244c695f382053d9225a3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.800175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 876/1749] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:12 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:12.801217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:12.806567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:12.847270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052d1cd1d5e244c695f382053d9225a3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:12.862921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 874/1750] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:12 2022] DELETE /identity/v3/users/052d1cd1d5e244c695f382053d9225a3 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:12.866019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:12.870133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:12.892332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:12.989885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8435e3-2a79-4073-90b8-7546050e6a9e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.029374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53160315-e8e9-46dd-b37c-03195cb7b9ec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.056824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.056824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.056824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.056824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.059345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:13.067117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:13.137683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387b7fb-e13a-465e-8c22-09e4667c4bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.145863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b7fb-e13a-465e-8c22-09e4667c4bfd service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.145863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b7fb-e13a-465e-8c22-09e4667c4bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.145863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b7fb-e13a-465e-8c22-09e4667c4bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.145863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3387b7fb-e13a-465e-8c22-09e4667c4bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:13.160691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387b7fb-e13a-465e-8c22-09e4667c4bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:13.162568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387b7fb-e13a-465e-8c22-09e4667c4bfd service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:13.176016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 877/1751] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:13.177979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.178268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.178554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.198589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 875/1752] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:12 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:13.206300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:13.217949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:13.222881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:13.228767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e55c-b0e8-4e95-b2a8-9ebe6a97c7c2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.239244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 878/1753] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:13.245588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.246706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.247310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.247769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.248691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:13.253960 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:13.255535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:13.255999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:13.278344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff5e56-5e93-44fa-8339-1ce9f2cd9f9e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.281335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 876/1754] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:13.291298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:13.292105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.293910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.294200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.294478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.313358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:13.314658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f24e7-915d-4817-b159-8b073ed3c7a4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.320975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:13.322544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:13.331842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.332621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.332983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.333338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] PATH_INFO: `/v3/projects/8352a4042190415996aaa51032313d2b/users/c3ba3748e4cc407f86c6e7e3fdcd062a/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.353140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 879/1755] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:13.383690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8352a4042190415996aaa51032313d2b, user_id=c3ba3748e4cc407f86c6e7e3fdcd062a, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:13.387719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:13.487606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 877/1756] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:13 2022] PUT /identity/v3/projects/8352a4042190415996aaa51032313d2b/users/c3ba3748e4cc407f86c6e7e3fdcd062a/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:13.488219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:13.507381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ef47-9a7e-4b3f-b541-49f5b9829604 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.589162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9953c3-3736-480e-86ee-826eb1438d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.590766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9953c3-3736-480e-86ee-826eb1438d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.591057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9953c3-3736-480e-86ee-826eb1438d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.591669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9953c3-3736-480e-86ee-826eb1438d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.592534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9953c3-3736-480e-86ee-826eb1438d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:13.596261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9953c3-3736-480e-86ee-826eb1438d6e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:13.613483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 880/1757] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:23:13.616003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:13.634100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de398bb-6cb5-4add-81d1-43622dfba07e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.648404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.649518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.650009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.650833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] PATH_INFO: `/v3/projects/8352a4042190415996aaa51032313d2b/users/c3ba3748e4cc407f86c6e7e3fdcd062a/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.660957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8352a4042190415996aaa51032313d2b, user_id=c3ba3748e4cc407f86c6e7e3fdcd062a, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:13.669198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:13.686453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 878/1758] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:13 2022] PUT /identity/v3/projects/8352a4042190415996aaa51032313d2b/users/c3ba3748e4cc407f86c6e7e3fdcd062a/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:13.698790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.699064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.699348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:13.730964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] MFA Rules not processed for user `c3ba3748e4cc407f86c6e7e3fdcd062a`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:13.732301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:13.823661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 881/1759] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:13.837468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:13.839333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:13.985896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:13.987497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d134-6dcb-4d34-a753-926c37eb3c48 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:13.996558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:13.997632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:13.998123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:13.998580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:14.031015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:14.036506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:14.058518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 879/1760] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:14.220350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:14.254328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:14.259880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:14.305365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:14.322479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00aff-e162-4f9e-8f97-330ede3f40bf service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:14.327102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96943de-6f87-4380-a892-4301bebdd2c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:14.328186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96943de-6f87-4380-a892-4301bebdd2c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:14.328672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96943de-6f87-4380-a892-4301bebdd2c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:14.329848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96943de-6f87-4380-a892-4301bebdd2c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:14.332331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f96943de-6f87-4380-a892-4301bebdd2c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:14.396996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013da7-9814-46d8-b1c8-68413f83a5f0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:14.402955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:14.403674 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:14.403958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:14.404294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] PATH_INFO: `/v3/projects/27b2cae9214e4013869f83cd5b7422cf` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:14.406177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b2cae9214e4013869f83cd5b7422cf)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:14.409318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:14.438270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96943de-6f87-4380-a892-4301bebdd2c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:14.441962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96943de-6f87-4380-a892-4301bebdd2c9 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:14.455764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 880/1761] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:23:14.560579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b2cae9214e4013869f83cd5b7422cf', 'request_id': 'req-31d39bab-1707-4e03-9eb7-0b8474368b37'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:14.573140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b2cae9214e4013869f83cd5b7422cf', 'request_id': 'req-31d39bab-1707-4e03-9eb7-0b8474368b37'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:14.582482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b2cae9214e4013869f83cd5b7422cf', 'request_id': 'req-31d39bab-1707-4e03-9eb7-0b8474368b37'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:14.676216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] The token cache is being invalidate because project 27b2cae9214e4013869f83cd5b7422cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:14.676530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:14.677566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-31d39bab-1707-4e03-9eb7-0b8474368b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:14.685020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 882/1762] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:14 2022] DELETE /identity/v3/projects/27b2cae9214e4013869f83cd5b7422cf => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:14.687318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e450436-4b54-4bc2-9ac1-1f2eada104e4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:14.687618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e450436-4b54-4bc2-9ac1-1f2eada104e4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:14.687903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e450436-4b54-4bc2-9ac1-1f2eada104e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:14.744802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7e450436-4b54-4bc2-9ac1-1f2eada104e4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:14.746091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7e450436-4b54-4bc2-9ac1-1f2eada104e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:14.918578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 881/1763] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:14.919495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3821da-630e-4c19-ac92-ef5b10f10dce None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:14.919890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3821da-630e-4c19-ac92-ef5b10f10dce None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:14.920273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3821da-630e-4c19-ac92-ef5b10f10dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:14.951326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7f3821da-630e-4c19-ac92-ef5b10f10dce None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:14.956359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7f3821da-630e-4c19-ac92-ef5b10f10dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:14.983948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e450436-4b54-4bc2-9ac1-1f2eada104e4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:14.991306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 883/1764] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:14.996549 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e450436-4b54-4bc2-9ac1-1f2eada104e4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:15.022095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:15.024968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.025528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.025792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.029756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:15.029756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:15.031728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:15.054988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3821da-630e-4c19-ac92-ef5b10f10dce None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:15.055510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 882/1765] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:15.073698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3821da-630e-4c19-ac92-ef5b10f10dce None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:15.126736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:15.127670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.128151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.128712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.131439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:15.137941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:15.272187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 884/1766] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:15 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:15.273567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:15.297249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05e8c9-c274-4e95-9b6f-56e34140fc60 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:15.386282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:15.395262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:15.395262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.395623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.395821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.396481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:15.398685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:15.441958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:15.473168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 883/1767] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:15 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:15.477099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:15.491486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342797-4bf9-4005-bcde-5ff7bf3323c8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:15.498538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:15.499291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.499677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.500034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.501407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:15.503954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:15.521707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 885/1768] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:23:15.531608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:15.572672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd7398-2e3c-46b2-b218-159eacacb20a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:15.590957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:15.592130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.592850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.592850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.595263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:15.599115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:15.634405 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 884/1769] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:15.635901 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:15.650487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4c16e-fbb0-42a0-9bea-b77d3259767c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:15.665028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f35f2-f0fd-458e-a2b6-b97466571538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:15.665028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f35f2-f0fd-458e-a2b6-b97466571538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.665028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f35f2-f0fd-458e-a2b6-b97466571538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.665028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f35f2-f0fd-458e-a2b6-b97466571538 admin admin] PATH_INFO: `/v3/projects/85d4bdd434f546ff803b052eb6e154ce/users/86ce8d9e903343fd9f10ea9628980dd0/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.694695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f35f2-f0fd-458e-a2b6-b97466571538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d4bdd434f546ff803b052eb6e154ce, user_id=86ce8d9e903343fd9f10ea9628980dd0, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:15.698933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f35f2-f0fd-458e-a2b6-b97466571538 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:15.742966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:15.745273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:15.767633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc87f-5240-412a-b1f5-05e702a8d8c3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:15.775060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 886/1770] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:15 2022] PUT /identity/v3/projects/85d4bdd434f546ff803b052eb6e154ce/users/86ce8d9e903343fd9f10ea9628980dd0/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:15.787388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021ea97-6cbd-4a70-a936-774acbd90a47 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.788252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021ea97-6cbd-4a70-a936-774acbd90a47 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.788557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021ea97-6cbd-4a70-a936-774acbd90a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.881001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e021ea97-6cbd-4a70-a936-774acbd90a47 None None] MFA Rules not processed for user `86ce8d9e903343fd9f10ea9628980dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:15.884182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e021ea97-6cbd-4a70-a936-774acbd90a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:15.912419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:15.913112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:15.913395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:15.913708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] PATH_INFO: `/v3/projects/b6a07765cc494ad69b54fb99dade49c5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:15.918213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a07765cc494ad69b54fb99dade49c5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:15.924341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:16.064375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 887/1771] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:16.067225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021ea97-6cbd-4a70-a936-774acbd90a47 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:16.089154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a07765cc494ad69b54fb99dade49c5', 'request_id': 'req-612e821e-27ee-4adf-b2e4-b40d775d981c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.102779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021ea97-6cbd-4a70-a936-774acbd90a47 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:16.103597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a07765cc494ad69b54fb99dade49c5', 'request_id': 'req-612e821e-27ee-4adf-b2e4-b40d775d981c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.195197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a07765cc494ad69b54fb99dade49c5', 'request_id': 'req-612e821e-27ee-4adf-b2e4-b40d775d981c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.201500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:16.202190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:16.202473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:16.208975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:16.208975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:16.208975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:16.251531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] The token cache is being invalidate because project b6a07765cc494ad69b54fb99dade49c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:16.251531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.251531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.251531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 885/1772] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:15 2022] DELETE /identity/v3/projects/b6a07765cc494ad69b54fb99dade49c5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:16.254725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:16.255591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:16.270701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e821e-27ee-4adf-b2e4-b40d775d981c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:16.277562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:16.279442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:16.279442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:16.279442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] PATH_INFO: `/v3/users/56298ec05b3243a08e0d4df2484fbcc8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:16.280606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=56298ec05b3243a08e0d4df2484fbcc8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:16.282850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:16.344032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 888/1773] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:16 2022] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:16.348783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:16.351528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:16.511929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24de7ba-109e-4076-a282-b172174b30d1 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:16.527225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:16.529301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:16.530330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:16.533315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:16.534899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:16.540759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:16.580241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56298ec05b3243a08e0d4df2484fbcc8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.582490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56298ec05b3243a08e0d4df2484fbcc8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.611207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56298ec05b3243a08e0d4df2484fbcc8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.620822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56298ec05b3243a08e0d4df2484fbcc8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.679041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56298ec05b3243a08e0d4df2484fbcc8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:16.687746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 889/1774] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:16 2022] POST /identity/v3/users => generated 291 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:16.691322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 886/1775] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:16 2022] DELETE /identity/v3/users/56298ec05b3243a08e0d4df2484fbcc8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:16.692621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:16.696553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:16.754760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308be85-3424-43af-a0d1-b188ffd1fa55 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:16.878002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:16.919779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:16.920555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:16.921497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:16.921891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:16.922717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:16.925175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:16.937952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 890/1776] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:16.943356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:16.964427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137bf6b-b0d1-41bf-96ca-a6239f2d16ba admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:16.984617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:16.985703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:16.986343 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:16.986964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] PATH_INFO: `/v3/projects/d2991ee3e21445d8a47e0fc2013c0b0b/users/ac7a3d6ed0654439a3ff3f6716688e7c/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:16.995701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:16.997844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:17.025017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2991ee3e21445d8a47e0fc2013c0b0b, user_id=ac7a3d6ed0654439a3ff3f6716688e7c, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:17.029516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:17.030227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa79a-252f-4c89-b79d-346be5ef38f9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:17.036917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:17.038000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.038393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.038774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] PATH_INFO: `/v3/users/edbaf0eb415046ddb2e4da092c8ff1de` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:17.047181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbaf0eb415046ddb2e4da092c8ff1de)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:17.052313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:17.107705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 887/1777] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:16 2022] PUT /identity/v3/projects/d2991ee3e21445d8a47e0fc2013c0b0b/users/ac7a3d6ed0654439a3ff3f6716688e7c/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:17.111745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:17.215468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd1bd-5360-4991-b56b-1b3fabd90631 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:17.222965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:17.224163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.224454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.225115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:17.226373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:17.229981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:17.251174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 888/1778] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:17.253932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:17.271846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d11f4d-948c-4739-8133-1794f5960c5f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:17.279138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a9aef-9794-4961-8a8c-8c8c3417e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:17.282180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:17.295392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a9aef-9794-4961-8a8c-8c8c3417e89c admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.295834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a9aef-9794-4961-8a8c-8c8c3417e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.296292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a9aef-9794-4961-8a8c-8c8c3417e89c admin admin] PATH_INFO: `/v3/projects/d2991ee3e21445d8a47e0fc2013c0b0b/users/ac7a3d6ed0654439a3ff3f6716688e7c/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:17.304215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a9aef-9794-4961-8a8c-8c8c3417e89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2991ee3e21445d8a47e0fc2013c0b0b, user_id=ac7a3d6ed0654439a3ff3f6716688e7c, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:17.311181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a9aef-9794-4961-8a8c-8c8c3417e89c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:17.354904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbaf0eb415046ddb2e4da092c8ff1de'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:17.358401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbaf0eb415046ddb2e4da092c8ff1de'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:17.382023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 889/1779] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:17 2022] PUT /identity/v3/projects/d2991ee3e21445d8a47e0fc2013c0b0b/users/ac7a3d6ed0654439a3ff3f6716688e7c/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:17.382913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbaf0eb415046ddb2e4da092c8ff1de'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:17.385371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f92cf-703d-49dd-8d61-0ed1d66a02ec None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.385894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f92cf-703d-49dd-8d61-0ed1d66a02ec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.387099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f92cf-703d-49dd-8d61-0ed1d66a02ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:17.437492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e82f92cf-703d-49dd-8d61-0ed1d66a02ec None None] MFA Rules not processed for user `ac7a3d6ed0654439a3ff3f6716688e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:17.439270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e82f92cf-703d-49dd-8d61-0ed1d66a02ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:17.472024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbaf0eb415046ddb2e4da092c8ff1de'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:17.472697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4acfe4d0-2492-4faf-bada-461afa285e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbaf0eb415046ddb2e4da092c8ff1de'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:17.510355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 891/1780] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:16 2022] DELETE /identity/v3/users/edbaf0eb415046ddb2e4da092c8ff1de => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:17.512111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.512415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.512715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:17.557628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:17.559386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 890/1781] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:17.562946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:17.563105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.563105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.563105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:17.630041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] MFA Rules not processed for user `f5a85438fda6446fa7d9b31da11d539b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:17.633078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:17.732193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 892/1782] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:17.732193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:17.732193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:17.769639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 891/1783] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:17.772585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:17.772585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:17.853650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae83cf-3788-4943-9435-1d75d3a5bb20 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:17.859950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:17.865951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.866566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.867170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:17.880316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:17.882072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:17.904979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 892/1784] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:17.929401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96f42-156b-4b59-94e6-c755065321b6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:17.938827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:17.939794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:17.940509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:17.941034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:18.051387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:18.052836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:18.070799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 893/1785] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:18.073756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:18.078213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:18.101189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873a083-0fc8-4bb8-ba2f-6d1756fd2997 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:18.109239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:18.110342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:18.110914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:18.111428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] PATH_INFO: `/v3/projects/806cd362a77a4b069ec0b57a32c957cf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:18.112858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806cd362a77a4b069ec0b57a32c957cf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:18.115078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:18.261192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:18.341866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806cd362a77a4b069ec0b57a32c957cf', 'request_id': 'req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.350312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806cd362a77a4b069ec0b57a32c957cf', 'request_id': 'req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.384526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:18.386972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:18.424573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c39b26-0420-4226-8e04-f56e55ba2c89 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:18.481152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806cd362a77a4b069ec0b57a32c957cf', 'request_id': 'req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.506660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] The token cache is being invalidate because project 806cd362a77a4b069ec0b57a32c957cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:18.506991 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.510175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b5e31ff9-bfca-4e43-8e0a-301a3a31f0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.519162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 893/1786] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:18 2022] DELETE /identity/v3/projects/806cd362a77a4b069ec0b57a32c957cf => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:18.519162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecdd8a-3c35-4589-80b3-11edb254543d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:18.520247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecdd8a-3c35-4589-80b3-11edb254543d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:18.520605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecdd8a-3c35-4589-80b3-11edb254543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-edecdd8a-3c35-4589-80b3-11edb254543d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:18.528870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:18.529706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:23:18.544087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 894/1787] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:18.562858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc233d-c31c-4613-b6e7-ba95ece0ed1c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:18.562858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc233d-c31c-4613-b6e7-ba95ece0ed1c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:18.563209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc233d-c31c-4613-b6e7-ba95ece0ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:18.574333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:18.589062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:18.590444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:18.592153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:18.592632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] PATH_INFO: `/v3/users/e88b4253cdef44f0a1f0a5ca2b5733dc` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:18.596232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88b4253cdef44f0a1f0a5ca2b5733dc)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:18.628718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-47fc233d-c31c-4613-b6e7-ba95ece0ed1c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:18.628718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-47fc233d-c31c-4613-b6e7-ba95ece0ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:18.642829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:18.644660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 895/1788] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:18.652689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c20c8-fa56-4fa2-9056-9d5d73b63ce1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:18.654069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c20c8-fa56-4fa2-9056-9d5d73b63ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:18.654655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c20c8-fa56-4fa2-9056-9d5d73b63ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:18.732035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-074c20c8-fa56-4fa2-9056-9d5d73b63ce1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:18.759294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-074c20c8-fa56-4fa2-9056-9d5d73b63ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:18.792164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 896/1789] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:18.795895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c20c8-fa56-4fa2-9056-9d5d73b63ce1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:18.824509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c20c8-fa56-4fa2-9056-9d5d73b63ce1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:18.838828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:18.839778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:18.841634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:18.842837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:18.847359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:18.848333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:18.869327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:18.902957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88b4253cdef44f0a1f0a5ca2b5733dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.905565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88b4253cdef44f0a1f0a5ca2b5733dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.906790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 897/1790] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:18.908320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:18.917453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:18.954843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88b4253cdef44f0a1f0a5ca2b5733dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:18.966783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ec13-2921-42be-9507-b387fe591af3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:18.981361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:18.990286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:18.990968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:18.991472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] PATH_INFO: `/v3/projects/1b3910d95a2f446b94c80803daa403d9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:19.010277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3910d95a2f446b94c80803daa403d9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:19.019617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:19.052894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88b4253cdef44f0a1f0a5ca2b5733dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.053815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88b4253cdef44f0a1f0a5ca2b5733dc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.073009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 894/1791] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:18 2022] DELETE /identity/v3/users/e88b4253cdef44f0a1f0a5ca2b5733dc => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:19.074276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:19.078270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:19.189982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9836-28a4-4945-8457-292a5ccac4d7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:19.210381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3910d95a2f446b94c80803daa403d9', 'request_id': 'req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.220114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3910d95a2f446b94c80803daa403d9', 'request_id': 'req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.310576 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:19.311288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:19.312036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:19.312036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:19.312604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:19.325400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3910d95a2f446b94c80803daa403d9', 'request_id': 'req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.337639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:19.354689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] The token cache is being invalidate because project 1b3910d95a2f446b94c80803daa403d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:19.355768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.357866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.366815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 898/1792] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:18 2022] DELETE /identity/v3/projects/1b3910d95a2f446b94c80803daa403d9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:19.372872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:19.374792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:19.403448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547df9-a9f2-4fbb-be26-dc81fd62ebf3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:19.405240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:19.406709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:19.407067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:19.407353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] PATH_INFO: `/v3/users/a38aa68b60e5410898a94a0fc65f7ac7` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:19.410017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38aa68b60e5410898a94a0fc65f7ac7)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:19.412068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:19.446890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:19.488348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 895/1793] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:19 2022] POST /identity/v3/projects => generated 365 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:19.490034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:19.495152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:19.599409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256e85-3064-462b-96a9-a8b999531e10 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:19.605022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:19.605812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:19.606028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:19.611425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] PATH_INFO: `/v3/projects/254a6dfd6f804ac39d87ac865dba2fd7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:19.611425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254a6dfd6f804ac39d87ac865dba2fd7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:19.611425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:19.682633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:19.703017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38aa68b60e5410898a94a0fc65f7ac7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.704040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38aa68b60e5410898a94a0fc65f7ac7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.735886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254a6dfd6f804ac39d87ac865dba2fd7', 'request_id': 'req-8bb21de6-9c94-4e0b-a152-653adaa77244'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.738225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38aa68b60e5410898a94a0fc65f7ac7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.750205 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254a6dfd6f804ac39d87ac865dba2fd7', 'request_id': 'req-8bb21de6-9c94-4e0b-a152-653adaa77244'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.758115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254a6dfd6f804ac39d87ac865dba2fd7', 'request_id': 'req-8bb21de6-9c94-4e0b-a152-653adaa77244'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.765529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38aa68b60e5410898a94a0fc65f7ac7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.859020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] The token cache is being invalidate because project 254a6dfd6f804ac39d87ac865dba2fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:19.862091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.871818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.874044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 896/1794] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:19 2022] DELETE /identity/v3/projects/254a6dfd6f804ac39d87ac865dba2fd7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:19.874680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:19.877614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:19.909411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5f2dd3ac-b729-4f75-ba7c-6d3d97b34536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38aa68b60e5410898a94a0fc65f7ac7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:19.918879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 899/1795] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:19 2022] DELETE /identity/v3/users/a38aa68b60e5410898a94a0fc65f7ac7 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:19.920766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d3b0c-d439-430e-9c80-37556aa51a93 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:19.921176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d3b0c-d439-430e-9c80-37556aa51a93 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:19.921940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d3b0c-d439-430e-9c80-37556aa51a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:19.969198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9f3d3b0c-d439-430e-9c80-37556aa51a93 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:19.971014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9f3d3b0c-d439-430e-9c80-37556aa51a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:20.039763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21de6-9c94-4e0b-a152-653adaa77244 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.104954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 900/1796] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:20.114424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0f38-a306-4dbe-91d5-1cb9d16fabc6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.114839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0f38-a306-4dbe-91d5-1cb9d16fabc6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.116493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0f38-a306-4dbe-91d5-1cb9d16fabc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.162117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1f4a0f38-a306-4dbe-91d5-1cb9d16fabc6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:20.163579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1f4a0f38-a306-4dbe-91d5-1cb9d16fabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:20.181758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 901/1797] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:20.187068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a0f38-a306-4dbe-91d5-1cb9d16fabc6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.209340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a0f38-a306-4dbe-91d5-1cb9d16fabc6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.214567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.214567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.214567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.214567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.215097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.215724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.218038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.222035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.222174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.222479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.223340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:20.223712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.231556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.247854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 902/1798] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:20.254313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.267732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346ee5-e467-44e4-816e-58526d8a1b86 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.275240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.276224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.276820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.277286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.278189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.280431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.349270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 897/1799] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:19 2022] POST /identity/v3/users => generated 283 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:20.350355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.356017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:20.392481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada8bb-9292-4046-beb1-32b412d09ca3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.400529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.401113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.401395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.401667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.402407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.403578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 903/1800] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:20 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:20.408389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.408867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.434999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 898/1801] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:20.440126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.462242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b149b2-a3c3-45b1-bfd9-dd4b3ba47fe8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.616512 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766c421-bcff-4eba-a1bd-249dfd2d1137 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.618047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.618947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.619791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.620081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.620799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.624135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.630555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965360f5-1878-4c6b-b64b-da82b1d764cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.632886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965360f5-1878-4c6b-b64b-da82b1d764cb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.634007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965360f5-1878-4c6b-b64b-da82b1d764cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.637618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965360f5-1878-4c6b-b64b-da82b1d764cb admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.638496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965360f5-1878-4c6b-b64b-da82b1d764cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.642195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965360f5-1878-4c6b-b64b-da82b1d764cb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.662129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 899/1802] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:20.667592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.682039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e776-5bcf-4f33-bb27-ca83383dcbb7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.688111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.689918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.690563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.691168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] PATH_INFO: `/v3/projects/94857f1e503047b78524e7d9f77fe142/users/1198f475c9f9464cac3a459a65b6a5fe/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.720040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94857f1e503047b78524e7d9f77fe142, user_id=1198f475c9f9464cac3a459a65b6a5fe, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.723927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.789366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 904/1803] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:20 2022] POST /identity/v3/users => generated 295 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:23:20.789366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a4a2a-957a-48d8-8bcc-14a79307f9c9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.789366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a4a2a-957a-48d8-8bcc-14a79307f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.789693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a4a2a-957a-48d8-8bcc-14a79307f9c9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.791721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 905/1804] 10.222.0.71 () {54 vars in 921 bytes} [Tue Aug 2 09:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:23:20.792609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a4a2a-957a-48d8-8bcc-14a79307f9c9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.799690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc3a4a2a-957a-48d8-8bcc-14a79307f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:20.812928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 900/1805] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:20 2022] PUT /identity/v3/projects/94857f1e503047b78524e7d9f77fe142/users/1198f475c9f9464cac3a459a65b6a5fe/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:20.813867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:20.887374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:20.922400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7b4e2-c5be-4d1e-920d-c8bfc7f7bee0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.929260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49d888-0220-444b-825b-c361a3b72f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.929950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d888-0220-444b-825b-c361a3b72f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.930718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d888-0220-444b-825b-c361a3b72f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.930718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d888-0220-444b-825b-c361a3b72f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.931489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49d888-0220-444b-825b-c361a3b72f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.933262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49d888-0220-444b-825b-c361a3b72f90 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:20.949702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 901/1806] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:20.951130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03768-5b9a-40e3-9f57-f5a0fc5e736e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.951235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a4a2a-957a-48d8-8bcc-14a79307f9c9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:20.951826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03768-5b9a-40e3-9f57-f5a0fc5e736e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.952118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03768-5b9a-40e3-9f57-f5a0fc5e736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.959056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:20.960466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:20.970373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:20.970847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] PATH_INFO: `/v3/projects/205e3722c26341e6a64334ed8e6d38be` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:20.972986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205e3722c26341e6a64334ed8e6d38be)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:20.975690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:21.003767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cac03768-5b9a-40e3-9f57-f5a0fc5e736e None None] MFA Rules not processed for user `1198f475c9f9464cac3a459a65b6a5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:21.004657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cac03768-5b9a-40e3-9f57-f5a0fc5e736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.147775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205e3722c26341e6a64334ed8e6d38be', 'request_id': 'req-aee7e49d-a3c0-423a-a887-149466077fa9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.154860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 902/1807] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:21.157432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.157762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.158047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.181531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205e3722c26341e6a64334ed8e6d38be', 'request_id': 'req-aee7e49d-a3c0-423a-a887-149466077fa9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.190731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] MFA Rules not processed for user `41aaa2d337974ae29ef28b1126e70435`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:21.192707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.201130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:21.246877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205e3722c26341e6a64334ed8e6d38be', 'request_id': 'req-aee7e49d-a3c0-423a-a887-149466077fa9'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.263376 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] The token cache is being invalidate because project 205e3722c26341e6a64334ed8e6d38be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:21.263675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.264368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.270884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 906/1808] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:20 2022] DELETE /identity/v3/projects/205e3722c26341e6a64334ed8e6d38be => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:21.272051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:21.274217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.306927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 903/1809] 10.222.0.71 () {58 vars in 1018 bytes} [Tue Aug 2 09:23:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:21.308488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:21.310415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.364653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7e49d-a3c0-423a-a887-149466077fa9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:21.369619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:21.370288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.370577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.370857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.371553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:21.373166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:21.383146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 907/1810] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:21.383839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:21.385440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.392769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ad510-7abc-40e3-a089-bfbc82fb7c95 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:21.397474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:21.398175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.398462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.398741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] PATH_INFO: `/v3/users/f6d86c4ecd7e4681b8942837246ecefa` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.399936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d86c4ecd7e4681b8942837246ecefa)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:21.404983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84bbd8-ce87-42e3-a2c0-51af6be498c2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:21.405106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:21.405184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a5cb-607f-4459-9735-2861dde5ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:21.405378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a5cb-607f-4459-9735-2861dde5ca6c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.405596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a5cb-607f-4459-9735-2861dde5ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.405955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a5cb-607f-4459-9735-2861dde5ca6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.406693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9a5cb-607f-4459-9735-2861dde5ca6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:21.409218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9a5cb-607f-4459-9735-2861dde5ca6c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:21.521170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 908/1811] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:21 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:21.521170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e49c0-8a3f-42a8-9f98-15c3e7deccd7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.521170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e49c0-8a3f-42a8-9f98-15c3e7deccd7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.521170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e49c0-8a3f-42a8-9f98-15c3e7deccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.542559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7d1e49c0-8a3f-42a8-9f98-15c3e7deccd7 None None] MFA Rules not processed for user `19e502fd45f34837bcf2caff0a82a668`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:21.543694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7d1e49c0-8a3f-42a8-9f98-15c3e7deccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.584260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d86c4ecd7e4681b8942837246ecefa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.584962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d86c4ecd7e4681b8942837246ecefa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.603962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d86c4ecd7e4681b8942837246ecefa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.620031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 909/1812] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:21.622103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.623722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.624014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.654917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:21.658676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.664117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d86c4ecd7e4681b8942837246ecefa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.665319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d86c4ecd7e4681b8942837246ecefa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:21.686533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 904/1813] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:21 2022] DELETE /identity/v3/users/f6d86c4ecd7e4681b8942837246ecefa => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:21.690371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:21.690728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.825705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809812-b782-4a0d-85f4-bbea031a56b2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:21.829520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 910/1814] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:21.841299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:21.841299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.841630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41aaa2d337974ae29ef28b1126e70435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:21.841630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.841630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.841630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.841944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.861757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30f772-c7df-4535-aa22-f00bd7ac3dc8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:21.886571 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:21.890721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:21.931019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 905/1815] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:21.931019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:21.934715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:21.960641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9aec0-acd4-4696-b620-46e3bcd0fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:21.962137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9aec0-acd4-4696-b620-46e3bcd0fc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:21.964111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9aec0-acd4-4696-b620-46e3bcd0fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:21.967630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9aec0-acd4-4696-b620-46e3bcd0fc74 admin admin] PATH_INFO: `/v3/projects/6b247d756a8f4abe8d585802df6c862a/users/bc0247a0b7c64fa8800397a47b823931/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:21.984177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9aec0-acd4-4696-b620-46e3bcd0fc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b247d756a8f4abe8d585802df6c862a, user_id=bc0247a0b7c64fa8800397a47b823931, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:21.987573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9aec0-acd4-4696-b620-46e3bcd0fc74 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.020369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731eff7-ada5-4557-a9e1-71cd48b00ec8 service placement] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.025398 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7758611-5bad-4ad9-98e7-ea43dd09cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.025979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7758611-5bad-4ad9-98e7-ea43dd09cc97 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.026265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7758611-5bad-4ad9-98e7-ea43dd09cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.026671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7758611-5bad-4ad9-98e7-ea43dd09cc97 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.027349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7758611-5bad-4ad9-98e7-ea43dd09cc97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.030463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7758611-5bad-4ad9-98e7-ea43dd09cc97 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.083339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 911/1816] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:21 2022] PUT /identity/v3/projects/6b247d756a8f4abe8d585802df6c862a/users/bc0247a0b7c64fa8800397a47b823931/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:22.086891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b60e8-b568-43ab-bf17-90eb3951ac86 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.086891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b60e8-b568-43ab-bf17-90eb3951ac86 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.086891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b60e8-b568-43ab-bf17-90eb3951ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.121891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-355b60e8-b568-43ab-bf17-90eb3951ac86 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:22.123254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-355b60e8-b568-43ab-bf17-90eb3951ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.170007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 906/1817] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:21 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:22.170007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.170007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.170007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.189636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:22.190891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.198411 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 912/1818] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:22.199761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 907/1819] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:22.200593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.201919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.204542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426597f-69d6-4c75-80f0-948cb5cebe70 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.204867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426597f-69d6-4c75-80f0-948cb5cebe70 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.205148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426597f-69d6-4c75-80f0-948cb5cebe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a426597f-69d6-4c75-80f0-948cb5cebe70 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:22.214607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:22.215406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:23:22.216686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38f16e-5e8b-44ef-81fc-7e25c11117a4 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.216789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 913/1820] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:22.217439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426597f-69d6-4c75-80f0-948cb5cebe70 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.236109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.236109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.236109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.236109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] PATH_INFO: `/v3/projects/67d335922f2845c49bac46273125a246` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.237318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d335922f2845c49bac46273125a246)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.237318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.240438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426597f-69d6-4c75-80f0-948cb5cebe70 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.245187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.245187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.245187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.245187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.247569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.247569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.262839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 914/1821] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:22.262839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.271825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb29a3-537c-4b65-bfc4-088833c4dac1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.281297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.282491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.282785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.283067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.283870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:22.284178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.285841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.298375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 915/1822] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:22.302080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.302080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.369460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743ff1-3199-47bd-ba11-a7b9bd739848 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.384712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d335922f2845c49bac46273125a246', 'request_id': 'req-b7cac459-266d-4727-81f0-9af616013d2b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:22.392443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d335922f2845c49bac46273125a246', 'request_id': 'req-b7cac459-266d-4727-81f0-9af616013d2b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:22.404517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d335922f2845c49bac46273125a246', 'request_id': 'req-b7cac459-266d-4727-81f0-9af616013d2b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:22.446202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.446934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.447216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.447493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.511010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.512498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.521698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] The token cache is being invalidate because project 67d335922f2845c49bac46273125a246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:22.522084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:22.522748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:22.524601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 908/1823] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:22 2022] DELETE /identity/v3/projects/67d335922f2845c49bac46273125a246 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:22.525384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 916/1824] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:22.526527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.535907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.536615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313bde2-72ea-4574-9e75-d4d3a0ee53b1 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.541281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.541543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dd88e-a023-47c2-a23f-0f9777043069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.544890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dd88e-a023-47c2-a23f-0f9777043069 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.545370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dd88e-a023-47c2-a23f-0f9777043069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.545844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dd88e-a023-47c2-a23f-0f9777043069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.547072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dd88e-a023-47c2-a23f-0f9777043069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.550801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dd88e-a023-47c2-a23f-0f9777043069 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.566590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cac459-266d-4727-81f0-9af616013d2b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.573694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.574401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.574684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.576053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] PATH_INFO: `/v3/projects/f6e6a5e2951b42cc8cd26925d87e3328/users/ece2298f4b90421295ad3aa0e7a02b67/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.591360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e6a5e2951b42cc8cd26925d87e3328, user_id=ece2298f4b90421295ad3aa0e7a02b67, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.594041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.659908 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 917/1825] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:22 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:22.661600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.662116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.662614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.688463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:22.689906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.697535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 909/1826] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:22 2022] PUT /identity/v3/projects/f6e6a5e2951b42cc8cd26925d87e3328/users/ece2298f4b90421295ad3aa0e7a02b67/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:22.697535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.708969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.747619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:22.768028 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 918/1827] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:22.769009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.793464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.801981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba79ed7-bbed-4b5f-a0ce-6da4c156b13b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.808924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.810039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.810530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.811376 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.812660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.817468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.865202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c1d49-c28f-4562-bc7d-164b60539e36 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.871277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.871956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.872244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.872527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] PATH_INFO: `/v3/users/86ce8d9e903343fd9f10ea9628980dd0` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.878174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ce8d9e903343fd9f10ea9628980dd0)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.883059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.914393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 919/1828] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:22 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:22.914393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.932254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd46bb-b468-4cc1-a09f-e2921654cb85 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:22.937127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f52dd-e01e-4abc-b42b-ef78a2ff3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:22.938860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f52dd-e01e-4abc-b42b-ef78a2ff3189 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.938860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f52dd-e01e-4abc-b42b-ef78a2ff3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.939198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f52dd-e01e-4abc-b42b-ef78a2ff3189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.939703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f52dd-e01e-4abc-b42b-ef78a2ff3189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:22.941359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f52dd-e01e-4abc-b42b-ef78a2ff3189 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:22.952262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 920/1829] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:22.953786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2520-93e8-4daf-b310-71b32d1cbb68 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:22.954083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2520-93e8-4daf-b310-71b32d1cbb68 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:22.954360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2520-93e8-4daf-b310-71b32d1cbb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:22.974194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1adb2520-93e8-4daf-b310-71b32d1cbb68 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:22.975431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1adb2520-93e8-4daf-b310-71b32d1cbb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:22.983654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 921/1830] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:22.984495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2520-93e8-4daf-b310-71b32d1cbb68 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:22.995148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2520-93e8-4daf-b310-71b32d1cbb68 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.011102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.012150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.012704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.013048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.014110 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.016356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.033684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 922/1831] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:23.041619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:23.055395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be1a95-f303-4c50-81ac-f46134be9a7b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.066935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.067936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.068424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.069298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] PATH_INFO: `/v3/projects/f6e6a5e2951b42cc8cd26925d87e3328/users/ece2298f4b90421295ad3aa0e7a02b67/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.074013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e6a5e2951b42cc8cd26925d87e3328, user_id=ece2298f4b90421295ad3aa0e7a02b67, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.076268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.088798 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 923/1832] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:23 2022] PUT /identity/v3/projects/f6e6a5e2951b42cc8cd26925d87e3328/users/ece2298f4b90421295ad3aa0e7a02b67/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:23.099438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:23.120531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ce8d9e903343fd9f10ea9628980dd0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.121219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ce8d9e903343fd9f10ea9628980dd0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.149574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ce8d9e903343fd9f10ea9628980dd0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.179303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1f46-0958-4a6c-9c66-2b2a2049fe48 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.184635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.185338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.185629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.186117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.186878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:23.187257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.189397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.206789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 924/1833] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:23.208050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:23.220938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a82f-2c8d-4d9c-bc75-df3728bbf4b8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.226616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929c3ba-aa6f-4674-8e5c-9cbaa2fbe4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.227555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c3ba-aa6f-4674-8e5c-9cbaa2fbe4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.228023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c3ba-aa6f-4674-8e5c-9cbaa2fbe4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.228511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c3ba-aa6f-4674-8e5c-9cbaa2fbe4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.229391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929c3ba-aa6f-4674-8e5c-9cbaa2fbe4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.231317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929c3ba-aa6f-4674-8e5c-9cbaa2fbe4c7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.237275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:23.262292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 925/1834] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:23.265538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.266204 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.267711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.279130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ce8d9e903343fd9f10ea9628980dd0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.280667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ce8d9e903343fd9f10ea9628980dd0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.308303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 910/1835] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:22 2022] DELETE /identity/v3/users/86ce8d9e903343fd9f10ea9628980dd0 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:23.309361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:23.310598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] MFA Rules not processed for user `ece2298f4b90421295ad3aa0e7a02b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:23.311118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:23.312514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:23.402476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 926/1836] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:23.403448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:23.405051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:23.419527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e183cc-cab3-4284-a410-912990f5434f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.420727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366b2cf-8ee0-4e0a-bb7d-d32a500c4e69 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.425233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.425948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.426614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.426614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] PATH_INFO: `/v3/projects/2f4261b957474abbb660bd89cd164b2a/users/bbdee25b783f47e59bdf8941733bda29/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.427597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714aafe-b17d-4c7d-9966-41336f8bd8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.429104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714aafe-b17d-4c7d-9966-41336f8bd8be admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.429462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714aafe-b17d-4c7d-9966-41336f8bd8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.429774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714aafe-b17d-4c7d-9966-41336f8bd8be admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.430597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714aafe-b17d-4c7d-9966-41336f8bd8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.432574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714aafe-b17d-4c7d-9966-41336f8bd8be admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.442952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4261b957474abbb660bd89cd164b2a, user_id=bbdee25b783f47e59bdf8941733bda29, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.446223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.582811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 927/1837] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:23 2022] PUT /identity/v3/projects/2f4261b957474abbb660bd89cd164b2a/users/bbdee25b783f47e59bdf8941733bda29/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:23.582811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:23.583208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 911/1838] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:23 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:23.583208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.583208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.583208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.583616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:23.623245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:23.624487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:23.699383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 912/1839] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:23.702569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11a1f6-f9d6-4370-b9c2-62bb6166a28d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.703489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:23.707020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:23.708922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.709591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.709905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.710190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] PATH_INFO: `/v3/users/2ac65b2e498a4f829c8182977ce0545d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.711702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac65b2e498a4f829c8182977ce0545d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.713887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.778120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f0949-73d6-4552-a238-da67230c1038 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:23.782881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d18569-e432-4bb7-ac7f-2875e1efc5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:23.783506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18569-e432-4bb7-ac7f-2875e1efc5eb service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.783792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18569-e432-4bb7-ac7f-2875e1efc5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.784070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18569-e432-4bb7-ac7f-2875e1efc5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.849292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d18569-e432-4bb7-ac7f-2875e1efc5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:23.849292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d18569-e432-4bb7-ac7f-2875e1efc5eb service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:23.860385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 913/1840] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:23.871768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385f60-2f4e-4ef1-bc4d-59d4990cf0ac None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:23.872057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385f60-2f4e-4ef1-bc4d-59d4990cf0ac None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:23.872338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385f60-2f4e-4ef1-bc4d-59d4990cf0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:23.905745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e4385f60-2f4e-4ef1-bc4d-59d4990cf0ac None None] MFA Rules not processed for user `bbdee25b783f47e59bdf8941733bda29`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:23.907141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e4385f60-2f4e-4ef1-bc4d-59d4990cf0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:23.919982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac65b2e498a4f829c8182977ce0545d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.920738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac65b2e498a4f829c8182977ce0545d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.935593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac65b2e498a4f829c8182977ce0545d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.947883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac65b2e498a4f829c8182977ce0545d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:23.997867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 914/1841] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:23.998986 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385f60-2f4e-4ef1-bc4d-59d4990cf0ac None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.018787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385f60-2f4e-4ef1-bc4d-59d4990cf0ac None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.023935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac65b2e498a4f829c8182977ce0545d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:24.039206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 928/1842] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:23 2022] DELETE /identity/v3/users/2ac65b2e498a4f829c8182977ce0545d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:24.044418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.045861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.050004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.052186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.052660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.053648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.055838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.058790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.120147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13024f-e602-4c95-b1f0-304ac87976a4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.123768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108283c0-4fe9-48dc-bab5-fc87d8301beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.124390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108283c0-4fe9-48dc-bab5-fc87d8301beb service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.124670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108283c0-4fe9-48dc-bab5-fc87d8301beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.125012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108283c0-4fe9-48dc-bab5-fc87d8301beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.127065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-108283c0-4fe9-48dc-bab5-fc87d8301beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.153795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 915/1843] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:23 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:24.154682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.164669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.167783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:24.185532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af9d18-d323-434f-be1b-3cd22fe9412e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.219163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108283c0-4fe9-48dc-bab5-fc87d8301beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.221218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108283c0-4fe9-48dc-bab5-fc87d8301beb service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.232872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 929/1844] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:24.234197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.234486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.235683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.267848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:24.269845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.279509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 930/1845] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:24.283555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.283555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.286365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.287235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.287534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.287817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.288505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.290784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.296912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177743e-3c8c-4225-8be3-18150be67e9d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.303902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.304544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.304829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.305109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.305849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.308650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.319078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 931/1846] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:24.320068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.322667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.382581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552e074-f138-4967-b421-ef995951e093 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.386312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.387066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.387383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.387533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.389314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.451985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.453457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.458745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 916/1847] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:24 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:24.458745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.461159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.464607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 932/1848] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:24.465514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.477174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889d1d-753e-4edf-a826-efafa7c9cbed service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.549858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2488-7efa-4842-a995-42d971ef5297 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.556925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.558626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.559153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.559679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.562165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.562829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.564185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.564185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.564360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.566096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.575297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.581165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 933/1849] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:24.582006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.597865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936c916-a008-46a0-b59e-bc849e1ddf09 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.604446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.605260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.605704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.606019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.606775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.612820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.612952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.640286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 917/1850] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:24.642678 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.658474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fb144-d8a5-49cb-89cc-1e9c5c9f8f11 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.664917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a01480-2e2d-4d14-916a-131ed584e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.665939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a01480-2e2d-4d14-916a-131ed584e4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.666496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a01480-2e2d-4d14-916a-131ed584e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.667443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a01480-2e2d-4d14-916a-131ed584e4ea admin admin] PATH_INFO: `/v3/projects/a28890dbf4a34181a76eb99f0e9570a6/users/a15e60f4b1504286ae54d14f4fea0c84/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.686648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a01480-2e2d-4d14-916a-131ed584e4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28890dbf4a34181a76eb99f0e9570a6, user_id=a15e60f4b1504286ae54d14f4fea0c84, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.690928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a01480-2e2d-4d14-916a-131ed584e4ea admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.739045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 934/1851] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:24 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:24.741394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.769909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 918/1852] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:24 2022] PUT /identity/v3/projects/a28890dbf4a34181a76eb99f0e9570a6/users/a15e60f4b1504286ae54d14f4fea0c84/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:24.773965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0a553-d098-4aed-900f-84e4c8925e15 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.780089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc256-5d22-4836-b9d0-4e39e9881e5a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.780386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc256-5d22-4836-b9d0-4e39e9881e5a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.780693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc256-5d22-4836-b9d0-4e39e9881e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.858068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2f3bc256-5d22-4836-b9d0-4e39e9881e5a None None] MFA Rules not processed for user `a15e60f4b1504286ae54d14f4fea0c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:24.859503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2f3bc256-5d22-4836-b9d0-4e39e9881e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:24.915161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.915934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.916266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.916504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:24.917215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:24.918905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:24.948410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 935/1853] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:24.950390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:24.979719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd1bb6-a7c1-46ab-8b59-0bb6d515cec5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:24.993199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47624b6c-db45-498e-a467-2c4133f47c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:24.994179 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47624b6c-db45-498e-a467-2c4133f47c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:24.994462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47624b6c-db45-498e-a467-2c4133f47c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:24.995165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47624b6c-db45-498e-a467-2c4133f47c0b admin admin] PATH_INFO: `/v3/projects/a5afeefca37e4202b0159c2ff4268b0a/users/a0646721525a43ff8a93d73bfbe95380/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.015479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47624b6c-db45-498e-a467-2c4133f47c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5afeefca37e4202b0159c2ff4268b0a, user_id=a0646721525a43ff8a93d73bfbe95380, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.015479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47624b6c-db45-498e-a467-2c4133f47c0b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.021306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 919/1854] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:25.026087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc256-5d22-4836-b9d0-4e39e9881e5a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:25.049854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc256-5d22-4836-b9d0-4e39e9881e5a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:25.062103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:25.064155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.064655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.064949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.065653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.071509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.131610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 936/1855] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:24 2022] PUT /identity/v3/projects/a5afeefca37e4202b0159c2ff4268b0a/users/a0646721525a43ff8a93d73bfbe95380/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:25.133144 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198913f-3283-4293-aaa0-35a2833f33bf None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.133822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198913f-3283-4293-aaa0-35a2833f33bf None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.134601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198913f-3283-4293-aaa0-35a2833f33bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.182039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0198913f-3283-4293-aaa0-35a2833f33bf None None] MFA Rules not processed for user `f5a85438fda6446fa7d9b31da11d539b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:25.183400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0198913f-3283-4293-aaa0-35a2833f33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:25.194407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 920/1856] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:25 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:23:25.199401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:25.307790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f55e9-22af-4f71-9427-6163a3eb9b1c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:25.319861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:25.319861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.319861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.319861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.320214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.320214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.326678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 937/1857] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:25.332039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 921/1858] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:25.335528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198913f-3283-4293-aaa0-35a2833f33bf None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:25.337110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:25.338267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:25.353212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e2365-f5cb-4445-a7a4-47350e68c80e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:25.359995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:25.361411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.361411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.361655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] PATH_INFO: `/v3/projects/85d4bdd434f546ff803b052eb6e154ce` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.362932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d4bdd434f546ff803b052eb6e154ce)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.364972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.454257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198913f-3283-4293-aaa0-35a2833f33bf None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:25.460331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:25.461231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.461494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.462286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.462969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.466807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.466914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:25.551127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d4bdd434f546ff803b052eb6e154ce', 'request_id': 'req-553eba20-0c94-4453-bf77-354398d3040b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:25.562429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d4bdd434f546ff803b052eb6e154ce', 'request_id': 'req-553eba20-0c94-4453-bf77-354398d3040b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:25.582157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d4bdd434f546ff803b052eb6e154ce', 'request_id': 'req-553eba20-0c94-4453-bf77-354398d3040b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:25.636835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 938/1859] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:25 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:25.637929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:25.656354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6d6c-3bdf-4193-8b03-99983f95b019 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:25.720502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] The token cache is being invalidate because project 85d4bdd434f546ff803b052eb6e154ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:25.721108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:25.721809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:25.725826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 922/1860] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:25 2022] DELETE /identity/v3/projects/85d4bdd434f546ff803b052eb6e154ce => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:25.727294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:25.728780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:25.742045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:25.745224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.746182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.746881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] PATH_INFO: `/v3/projects/a5afeefca37e4202b0159c2ff4268b0a/users/a0646721525a43ff8a93d73bfbe95380/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.750326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5afeefca37e4202b0159c2ff4268b0a, user_id=a0646721525a43ff8a93d73bfbe95380, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.756982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.790630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 939/1861] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:25 2022] PUT /identity/v3/projects/a5afeefca37e4202b0159c2ff4268b0a/users/a0646721525a43ff8a93d73bfbe95380/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:25.791972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:25.795119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:25.844654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eba20-0c94-4453-bf77-354398d3040b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:25.957084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3dad-e330-4dc0-a715-259150ee9a68 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:25.966246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:25.966892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.967177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.967463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.970315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.973604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.981908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:25.982746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:25.983003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:25.983246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] PATH_INFO: `/v3/projects/a582f71127dd4c10af7cee657bce321e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:25.986344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a582f71127dd4c10af7cee657bce321e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:25.990473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:25.997564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 940/1862] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:26.011669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:26.016857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:26.046037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258c77e-d311-431e-939a-212d3a1d0607 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:26.057176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:26.058106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:26.058425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:26.058775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] PATH_INFO: `/v3/users/ac7a3d6ed0654439a3ff3f6716688e7c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:26.060372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7a3d6ed0654439a3ff3f6716688e7c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:26.062850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:26.148293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a582f71127dd4c10af7cee657bce321e', 'request_id': 'req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.155121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a582f71127dd4c10af7cee657bce321e', 'request_id': 'req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.169297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a582f71127dd4c10af7cee657bce321e', 'request_id': 'req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.189884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:26.242809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] The token cache is being invalidate because project a582f71127dd4c10af7cee657bce321e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:26.243200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.244511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0d4cc5f-d5bb-490f-ac48-133daa7d6753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.246233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 923/1863] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:25 2022] DELETE /identity/v3/projects/a582f71127dd4c10af7cee657bce321e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:26.247477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef323eda-6032-4cff-8a80-6a2f580c7474 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:26.247826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef323eda-6032-4cff-8a80-6a2f580c7474 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:26.248215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef323eda-6032-4cff-8a80-6a2f580c7474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:26.295285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ef323eda-6032-4cff-8a80-6a2f580c7474 None None] MFA Rules not processed for user `a0646721525a43ff8a93d73bfbe95380`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:26.296714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ef323eda-6032-4cff-8a80-6a2f580c7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:26.342703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7a3d6ed0654439a3ff3f6716688e7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.343522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7a3d6ed0654439a3ff3f6716688e7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.377675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7a3d6ed0654439a3ff3f6716688e7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.407835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7a3d6ed0654439a3ff3f6716688e7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.447534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 924/1864] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:26.447888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506737e-a330-4c73-877b-546c5ca3694d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:26.448201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506737e-a330-4c73-877b-546c5ca3694d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:26.448666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506737e-a330-4c73-877b-546c5ca3694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a506737e-a330-4c73-877b-546c5ca3694d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:26.466267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:26.468855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:23:26.472906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 925/1865] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:26 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:26.472906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506737e-a330-4c73-877b-546c5ca3694d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:26.472906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a506737e-a330-4c73-877b-546c5ca3694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:26.520728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7a3d6ed0654439a3ff3f6716688e7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:26.529242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 941/1866] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:26 2022] DELETE /identity/v3/users/ac7a3d6ed0654439a3ff3f6716688e7c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:26.533010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:26.535946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:26.560327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506737e-a330-4c73-877b-546c5ca3694d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:26.664785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e853d5-9bc5-4818-b089-089b39609f91 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:26.668819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:26.669528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:26.684152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:26.684152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] PATH_INFO: `/v3/projects/2dea349d5530485682459d70b4d0a5fd/users/7191f5586375421e9e79a7f624540461/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:26.691514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:26.692355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:26.692639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:26.692920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] PATH_INFO: `/v3/users/c3ba3748e4cc407f86c6e7e3fdcd062a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:26.694356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ba3748e4cc407f86c6e7e3fdcd062a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:26.714895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:26.715125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dea349d5530485682459d70b4d0a5fd, user_id=7191f5586375421e9e79a7f624540461, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:26.718162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:26.794926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 926/1867] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:26 2022] PUT /identity/v3/projects/2dea349d5530485682459d70b4d0a5fd/users/7191f5586375421e9e79a7f624540461/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:26.796057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:26.798493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:26.948833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc256827-e06c-43c8-9988-653009cd94c5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:26.960620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:26.961280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:26.961636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:26.962014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:26.967504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:27.013405 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ba3748e4cc407f86c6e7e3fdcd062a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:27.013405 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ba3748e4cc407f86c6e7e3fdcd062a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:27.045157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ba3748e4cc407f86c6e7e3fdcd062a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:27.066489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ba3748e4cc407f86c6e7e3fdcd062a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:27.126773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:27.128238 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:27.154707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 927/1868] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:27.158011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:27.169795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:27.174815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ba3748e4cc407f86c6e7e3fdcd062a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:27.186502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 942/1869] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:26 2022] DELETE /identity/v3/users/c3ba3748e4cc407f86c6e7e3fdcd062a => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:27.262663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22311d6-92ad-49cf-8dda-2c49366a7e08 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:27.350268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e8306-d10c-4c1d-abd5-b16482116348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:27.351696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e8306-d10c-4c1d-abd5-b16482116348 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:27.352056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e8306-d10c-4c1d-abd5-b16482116348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:27.352388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e8306-d10c-4c1d-abd5-b16482116348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:27.353104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e8306-d10c-4c1d-abd5-b16482116348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:27.355376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e8306-d10c-4c1d-abd5-b16482116348 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:27.371643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 928/1870] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:27.376501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:27.378612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:27.403488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1428-c2cf-42c6-9e68-8e328688482b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:27.415143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:27.415862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:27.416167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:27.416483 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] PATH_INFO: `/v3/projects/2dea349d5530485682459d70b4d0a5fd/users/7191f5586375421e9e79a7f624540461/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:27.419003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dea349d5530485682459d70b4d0a5fd, user_id=7191f5586375421e9e79a7f624540461, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:27.423955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:27.441785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 943/1871] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:27 2022] PUT /identity/v3/projects/2dea349d5530485682459d70b4d0a5fd/users/7191f5586375421e9e79a7f624540461/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:27.452032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f135-b973-4ac0-9ad7-ad927724deb7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:27.453267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f135-b973-4ac0-9ad7-ad927724deb7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:27.453802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f135-b973-4ac0-9ad7-ad927724deb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:27.493434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1a83f135-b973-4ac0-9ad7-ad927724deb7 None None] MFA Rules not processed for user `7191f5586375421e9e79a7f624540461`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:27.495107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1a83f135-b973-4ac0-9ad7-ad927724deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:27.584950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:27.628074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 929/1872] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:27.640920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:27.642996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:27.723604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab25b1-9041-45fb-a372-153ff61624d1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:27.740533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:27.740533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:27.740533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:27.740533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:27.757286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:27.759838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:27.773883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 944/1873] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:28.057795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83f135-b973-4ac0-9ad7-ad927724deb7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:28.059440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:28.061012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:28.074368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83f135-b973-4ac0-9ad7-ad927724deb7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:28.088132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:28.089467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:28.089982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:28.090372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:28.095068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:28.191992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bc14-f98b-4116-a806-16ba6103a749 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:28.222196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:28.224169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:28.225573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:28.226381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:28.226837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:28.227198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] PATH_INFO: `/v3/projects/d2991ee3e21445d8a47e0fc2013c0b0b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:28.229790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2991ee3e21445d8a47e0fc2013c0b0b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:28.233749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:28.249995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 930/1874] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:28.436017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:28.468562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2991ee3e21445d8a47e0fc2013c0b0b', 'request_id': 'req-75cb8a67-2e1f-456a-921a-a5408b235664'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:28.476370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2991ee3e21445d8a47e0fc2013c0b0b', 'request_id': 'req-75cb8a67-2e1f-456a-921a-a5408b235664'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:28.535631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:28.537155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:28.568754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f27d-6e56-4bc8-b9a6-ce38b6950900 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:28.606154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2991ee3e21445d8a47e0fc2013c0b0b', 'request_id': 'req-75cb8a67-2e1f-456a-921a-a5408b235664'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:28.627622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] The token cache is being invalidate because project d2991ee3e21445d8a47e0fc2013c0b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:28.627993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:28.630053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-75cb8a67-2e1f-456a-921a-a5408b235664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:28.633052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 945/1875] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:28 2022] DELETE /identity/v3/projects/d2991ee3e21445d8a47e0fc2013c0b0b => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:28.639314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386648-c4f3-474d-8ab1-e39a85198323 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:28.639719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386648-c4f3-474d-8ab1-e39a85198323 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:28.646049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386648-c4f3-474d-8ab1-e39a85198323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:28.681360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:28.682059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:28.682347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:28.682629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] PATH_INFO: `/v3/projects/8352a4042190415996aaa51032313d2b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:28.684140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b9386648-c4f3-474d-8ab1-e39a85198323 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:28.685544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b9386648-c4f3-474d-8ab1-e39a85198323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:28.687181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8352a4042190415996aaa51032313d2b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:28.689362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:28.722556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 946/1876] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:28.730538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35198cbf-56df-44c2-97d4-225351f4d81b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:28.730810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35198cbf-56df-44c2-97d4-225351f4d81b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:28.731266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35198cbf-56df-44c2-97d4-225351f4d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:28.765567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-35198cbf-56df-44c2-97d4-225351f4d81b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:28.767758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-35198cbf-56df-44c2-97d4-225351f4d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:28.777292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 947/1877] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:28.781705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35198cbf-56df-44c2-97d4-225351f4d81b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:28.792496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35198cbf-56df-44c2-97d4-225351f4d81b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:28.800348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:28.801134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:28.801516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:28.801955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:28.802824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:28.803228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:28.805228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:28.830678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 948/1878] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:28.830678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:28.847372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e97849-1e26-4ee0-a9a0-eb441c608166 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:28.873375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:28.875779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:28.877100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:28.878234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:28.880678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:28.885419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:28.890457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8352a4042190415996aaa51032313d2b', 'request_id': 'req-cf841592-f61d-49da-bd00-69b611abad58'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:28.909955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8352a4042190415996aaa51032313d2b', 'request_id': 'req-cf841592-f61d-49da-bd00-69b611abad58'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:28.928982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8352a4042190415996aaa51032313d2b', 'request_id': 'req-cf841592-f61d-49da-bd00-69b611abad58'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.022533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 949/1879] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:28 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:23:29.026475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:29.056276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] The token cache is being invalidate because project 8352a4042190415996aaa51032313d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:29.056276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.056276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cf841592-f61d-49da-bd00-69b611abad58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.056276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 931/1880] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:28 2022] DELETE /identity/v3/projects/8352a4042190415996aaa51032313d2b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:29.058777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.059343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.061980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.111762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:29.123457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:29.233555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b505-9950-425b-b21d-604accc8ca69 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:29.253172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:29.253847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.254135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.254417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.255102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:29.258248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:29.271816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 932/1881] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:29.273890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:29.279170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:29.304154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ccf4-eec9-4900-aed8-673431b942ea None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:29.315994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:29.317001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.317354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.319839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] PATH_INFO: `/v3/users/bbdee25b783f47e59bdf8941733bda29` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.320136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbdee25b783f47e59bdf8941733bda29)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:29.324736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:29.396904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 950/1882] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:29 2022] POST /identity/v3/users => generated 289 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:29.396904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:29.400866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:29.423982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef8e5a-851d-42d1-95e6-00018815993e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:29.442728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:29.443399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.443956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.443956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] PATH_INFO: `/v3/users/1198f475c9f9464cac3a459a65b6a5fe` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.445156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1198f475c9f9464cac3a459a65b6a5fe)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:29.447228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:29.584349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbdee25b783f47e59bdf8941733bda29'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.585004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbdee25b783f47e59bdf8941733bda29'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.603088 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbdee25b783f47e59bdf8941733bda29'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.689676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbdee25b783f47e59bdf8941733bda29'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.690536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dd9095cb-55a3-45f9-a752-a73db1bb53cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbdee25b783f47e59bdf8941733bda29'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.710788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 933/1883] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:29 2022] DELETE /identity/v3/users/bbdee25b783f47e59bdf8941733bda29 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:29.712371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.712789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.713480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.746065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:29.747942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:29.778178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1198f475c9f9464cac3a459a65b6a5fe'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.782607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1198f475c9f9464cac3a459a65b6a5fe'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.802773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1198f475c9f9464cac3a459a65b6a5fe'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.810819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1198f475c9f9464cac3a459a65b6a5fe'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.829651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 934/1884] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:29.830846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:29.832310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:29.844474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e348f2-2c09-4175-b1fc-077c82b5d4d3 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:29.849487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb26536-d309-491e-9dc0-55fcec4a42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:29.850143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb26536-d309-491e-9dc0-55fcec4a42d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.850432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb26536-d309-491e-9dc0-55fcec4a42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.850708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb26536-d309-491e-9dc0-55fcec4a42d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.851411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb26536-d309-491e-9dc0-55fcec4a42d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:29.852996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb26536-d309-491e-9dc0-55fcec4a42d8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:29.873532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 935/1885] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:29.873532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec59fe-be54-4af4-86dc-0a4d790d9508 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:29.873532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec59fe-be54-4af4-86dc-0a4d790d9508 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:29.873532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec59fe-be54-4af4-86dc-0a4d790d9508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:29.892794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d1ec59fe-be54-4af4-86dc-0a4d790d9508 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:29.894062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d1ec59fe-be54-4af4-86dc-0a4d790d9508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:29.906063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 936/1886] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:29.906063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec59fe-be54-4af4-86dc-0a4d790d9508 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:29.909666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1198f475c9f9464cac3a459a65b6a5fe'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:29.915577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:29.918599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 951/1887] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:29 2022] DELETE /identity/v3/users/1198f475c9f9464cac3a459a65b6a5fe => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:29.919450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:29.920511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec59fe-be54-4af4-86dc-0a4d790d9508 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:29.925862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:30.044724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59deb2-6efb-474c-919e-e0d91d78cdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.045582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59deb2-6efb-474c-919e-e0d91d78cdeb admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.045981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59deb2-6efb-474c-919e-e0d91d78cdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.046683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59deb2-6efb-474c-919e-e0d91d78cdeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.048643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59deb2-6efb-474c-919e-e0d91d78cdeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:30.049048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59deb2-6efb-474c-919e-e0d91d78cdeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.051625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59deb2-6efb-474c-919e-e0d91d78cdeb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.071056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30935b-6ab1-4172-ae9a-8beffb467f01 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.078377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.080416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.081015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.081429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.082178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 937/1888] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:30.082977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.083798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.084190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.084708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.085291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.100569 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 952/1889] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:30.102245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.105430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:30.124508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:30.126852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:30.145175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 938/1890] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:30.145175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.145175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:30.162846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b448-d8cd-42a1-9d74-c9af916f043c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.168692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.169476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.170091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.170474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.171376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.175820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.269317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35ae90-058e-4375-9442-3f963e4149ed admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.273398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.274065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.274351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.274636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.276566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:30.287539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 939/1891] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:30 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:30.288568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.291037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.292987 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.305351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 953/1892] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:30.306427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.326285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8759b-f908-4ddf-9de7-b58d03114437 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.383697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8498f6-6072-44fd-8cc3-ae377f321cc2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.388261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbddccb-9a08-40ed-bd20-ba6916c767a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.389621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddccb-9a08-40ed-bd20-ba6916c767a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.391598 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddccb-9a08-40ed-bd20-ba6916c767a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.392513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.393031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddccb-9a08-40ed-bd20-ba6916c767a6 admin admin] PATH_INFO: `/v3/projects/db60edcc98cb406ab72225cdfcdd8236/users/c37639a91d384e7789e1f52013fa77b6/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.398370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.410511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.410511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.416554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.419140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.420878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbddccb-9a08-40ed-bd20-ba6916c767a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db60edcc98cb406ab72225cdfcdd8236, user_id=c37639a91d384e7789e1f52013fa77b6, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.424352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbddccb-9a08-40ed-bd20-ba6916c767a6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.434482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 954/1893] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:30.436254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.448150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc296d-99bf-4a3f-aee2-a646921542e4 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.458149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.458149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.458149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.458523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.460001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.462430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.627653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 940/1894] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:30 2022] PUT /identity/v3/projects/db60edcc98cb406ab72225cdfcdd8236/users/c37639a91d384e7789e1f52013fa77b6/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:30.631579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8713b-9bb1-49d0-ae10-c7487adba76d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.631991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8713b-9bb1-49d0-ae10-c7487adba76d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.632392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8713b-9bb1-49d0-ae10-c7487adba76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.680709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 955/1895] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:30 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:30.680922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-35b8713b-9bb1-49d0-ae10-c7487adba76d None None] MFA Rules not processed for user `c37639a91d384e7789e1f52013fa77b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:30.681881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.690199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-35b8713b-9bb1-49d0-ae10-c7487adba76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:30.696152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721b25-2804-48a0-a6fc-0f4fd96e80f9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.771625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.772540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.772926 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.773328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.774193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.776159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.784802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 941/1896] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:30.789568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8713b-9bb1-49d0-ae10-c7487adba76d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.790173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 956/1897] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:30.793203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.804131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8713b-9bb1-49d0-ae10-c7487adba76d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.820516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46937-8f77-4a2e-aed9-1d5ab313fddd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.820784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e8ed7-b85a-479e-a272-b77c0f1830af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.820784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e8ed7-b85a-479e-a272-b77c0f1830af admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.820784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e8ed7-b85a-479e-a272-b77c0f1830af admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.820784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e8ed7-b85a-479e-a272-b77c0f1830af admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.821149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e8ed7-b85a-479e-a272-b77c0f1830af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.821244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.821347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e8ed7-b85a-479e-a272-b77c0f1830af admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.821431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.821431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.821431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.821431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.821431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:30.835109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 957/1898] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:23:30.842345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:30.858392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9c9b5-bbff-415f-8465-d627ae5f7317 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:30.873003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:30.873667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:30.874320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:30.874501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] PATH_INFO: `/v3/projects/239f35d821354aaab7adf16cec3ef557/users/37fb78e504094a14b6d09f334b58aa5d/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:30.899221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=239f35d821354aaab7adf16cec3ef557, user_id=37fb78e504094a14b6d09f334b58aa5d, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:30.902325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:31.187721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 958/1899] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:30 2022] PUT /identity/v3/projects/239f35d821354aaab7adf16cec3ef557/users/37fb78e504094a14b6d09f334b58aa5d/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:31.220675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 942/1900] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:30 2022] POST /identity/v3/projects => generated 377 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:31.231605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:31.234923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:31.235306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:31.235746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:31.280126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] MFA Rules not processed for user `37fb78e504094a14b6d09f334b58aa5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:31.285647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:31.367742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b208f-0c7c-4263-b382-4a14dbebafbd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:31.441112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 943/1901] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:31.441112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:31.447281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:31.575289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:31.575938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:31.577500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:31.577876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:31.581121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:31.585876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:31.659562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c95c47-7003-4e80-8cb5-95bb157b09d1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:31.687104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:31.687104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:31.687104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:31.687104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] PATH_INFO: `/v3/projects/94857f1e503047b78524e7d9f77fe142` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:31.689096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=94857f1e503047b78524e7d9f77fe142)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:31.691020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:31.698907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:31.767482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 959/1902] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:31 2022] POST /identity/v3/users => generated 289 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:31.767482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:31.781939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce753-80c5-4bfc-9651-279f5efbbcac admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:31.802112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:31.802112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:31.802112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:31.802112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:31.802421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:31.802727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:31.948808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94857f1e503047b78524e7d9f77fe142', 'request_id': 'req-ba2e12f1-00e9-45b6-86c3-740b53743ffd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:31.960656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 960/1903] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:31 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:31.961627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:31.963774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:31.964539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94857f1e503047b78524e7d9f77fe142', 'request_id': 'req-ba2e12f1-00e9-45b6-86c3-740b53743ffd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:31.974882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94857f1e503047b78524e7d9f77fe142', 'request_id': 'req-ba2e12f1-00e9-45b6-86c3-740b53743ffd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.039312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58253-d31d-4bc9-bf8c-7e69924d1fc0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:32.044084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:32.044882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.045170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.045445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] PATH_INFO: `/v3/projects/2f4261b957474abbb660bd89cd164b2a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:32.046837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4261b957474abbb660bd89cd164b2a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:32.049969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:32.078109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:32.086201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] The token cache is being invalidate because project 94857f1e503047b78524e7d9f77fe142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:32.086495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.088056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.090065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 944/1904] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:31 2022] DELETE /identity/v3/projects/94857f1e503047b78524e7d9f77fe142 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:32.090675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:32.096918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:32.198575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e12f1-00e9-45b6-86c3-740b53743ffd admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:32.205241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:32.206217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.206507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.206786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:32.207954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:32.210279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:32.222917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 945/1905] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:32.223902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:32.227243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:32.243467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bae4d-983b-4f24-9f05-04458b7a2fa0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:32.246498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4261b957474abbb660bd89cd164b2a', 'request_id': 'req-4510ca67-328b-4233-9b1c-491b68293d7d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.272297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4261b957474abbb660bd89cd164b2a', 'request_id': 'req-4510ca67-328b-4233-9b1c-491b68293d7d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.326250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:32.326916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.327198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.327478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] PATH_INFO: `/v3/users/19e502fd45f34837bcf2caff0a82a668` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:32.329433 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e502fd45f34837bcf2caff0a82a668)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:32.332003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:32.389627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4261b957474abbb660bd89cd164b2a', 'request_id': 'req-4510ca67-328b-4233-9b1c-491b68293d7d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.404709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] The token cache is being invalidate because project 2f4261b957474abbb660bd89cd164b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:32.411296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.411296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.411296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 961/1906] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:31 2022] DELETE /identity/v3/projects/2f4261b957474abbb660bd89cd164b2a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:32.411296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:32.411296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:32.427163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510ca67-328b-4233-9b1c-491b68293d7d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:32.435207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:32.446494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.446494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.446494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:32.446494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:32.446494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:32.598672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 962/1907] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:32 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:32.598672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:32.599441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:32.617080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e502fd45f34837bcf2caff0a82a668'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.617080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e502fd45f34837bcf2caff0a82a668'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.622779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832600-a76d-466a-a262-bd8d24cbc1a2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:32.631029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:32.631951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.632308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.632656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] PATH_INFO: `/v3/users/ece2298f4b90421295ad3aa0e7a02b67` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:32.636229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece2298f4b90421295ad3aa0e7a02b67)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:32.638720 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:32.664293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e502fd45f34837bcf2caff0a82a668'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.726166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e502fd45f34837bcf2caff0a82a668'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.726912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e502fd45f34837bcf2caff0a82a668'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.759345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 946/1908] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:32 2022] DELETE /identity/v3/users/19e502fd45f34837bcf2caff0a82a668 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:32.760242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:32.762207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:32.835796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc925-a623-4724-9a68-c63af9950f09 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:32.842528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:32.843544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.843844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.844697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:32.845420 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:32.848261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:32.856429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece2298f4b90421295ad3aa0e7a02b67'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.857556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece2298f4b90421295ad3aa0e7a02b67'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.883304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece2298f4b90421295ad3aa0e7a02b67'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.885891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 947/1909] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:32.887268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:32.894405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:32.903288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece2298f4b90421295ad3aa0e7a02b67'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.913110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55cf2e-2641-4d83-a6a6-f4fe357a0045 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:32.918334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:32.919125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.919615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.920151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] PATH_INFO: `/v3/users/a0646721525a43ff8a93d73bfbe95380` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:32.921610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0646721525a43ff8a93d73bfbe95380)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:32.924400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:32.980996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1da748b6-ca89-4118-b34a-8a678c80428f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece2298f4b90421295ad3aa0e7a02b67'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:32.991512 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 963/1910] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:32 2022] DELETE /identity/v3/users/ece2298f4b90421295ad3aa0e7a02b67 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:32.994069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:32.994611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:32.995957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.035843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] MFA Rules not processed for user `bc0247a0b7c64fa8800397a47b823931`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:33.043608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.114677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 964/1911] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:33.115614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:33.117108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.135483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0646721525a43ff8a93d73bfbe95380'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.136203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0646721525a43ff8a93d73bfbe95380'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.171096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0646721525a43ff8a93d73bfbe95380'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.216804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482a4c1-69c3-4863-93b2-fe19c9d3af53 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:33.222902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:33.223545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:33.223858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:33.224096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.224803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:33.226496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:33.238156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 965/1912] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:33.242074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:33.244030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.252630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0646721525a43ff8a93d73bfbe95380'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.253594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0646721525a43ff8a93d73bfbe95380'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.257534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6ed1-2781-4801-adf9-e94b9d451ad0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:33.262353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:33.264937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:33.264937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:33.264937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] PATH_INFO: `/v3/projects/8bcd652179b3441592c2da54e9608a10/users/8ccc446ca35f4725b8e4e871336527c6/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.267660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 948/1913] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:32 2022] DELETE /identity/v3/users/a0646721525a43ff8a93d73bfbe95380 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:33.268575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:33.269962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.279974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcd652179b3441592c2da54e9608a10, user_id=8ccc446ca35f4725b8e4e871336527c6, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:33.283273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:33.289415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:33.367939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e644-c0f6-4d3c-a8e6-a4f5a7c7e779 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:33.388936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 966/1914] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:33 2022] PUT /identity/v3/projects/8bcd652179b3441592c2da54e9608a10/users/8ccc446ca35f4725b8e4e871336527c6/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:33.388936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:33.391997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.400334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2251f-e5e3-4d67-8287-be3f445f57e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:33.405622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2251f-e5e3-4d67-8287-be3f445f57e7 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:33.405622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2251f-e5e3-4d67-8287-be3f445f57e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:33.405622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2251f-e5e3-4d67-8287-be3f445f57e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.405622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-67f2251f-e5e3-4d67-8287-be3f445f57e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.498888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2251f-e5e3-4d67-8287-be3f445f57e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:33.501347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2251f-e5e3-4d67-8287-be3f445f57e7 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:33.513350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 949/1915] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:33.515493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:33.515740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:33.516569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.542174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad10810-7b90-4b70-8e8f-c0267c842299 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:33.545555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] MFA Rules not processed for user `f5a85438fda6446fa7d9b31da11d539b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:33.550573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:33.551317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:33.551602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:33.551880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] PATH_INFO: `/v3/projects/ef3f66c3db574fae8ae5760c508592c2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.553020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.553689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3f66c3db574fae8ae5760c508592c2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:33.556164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:33.629478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 950/1916] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:33.633082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:33.633082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.659011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c44fb-de57-4181-ab87-120c4b58ad26 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:33.664534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cae80a-e8e0-4336-9038-becfa87887d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:33.665295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cae80a-e8e0-4336-9038-becfa87887d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:33.665684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cae80a-e8e0-4336-9038-becfa87887d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:33.666112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cae80a-e8e0-4336-9038-becfa87887d3 admin admin] PATH_INFO: `/v3/projects/81df25c08f98400fb01509f2c83ae907/users/10f312a70f9b4252b33176fc3b782daf/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.681784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:33.685607 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cae80a-e8e0-4336-9038-becfa87887d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81df25c08f98400fb01509f2c83ae907, user_id=10f312a70f9b4252b33176fc3b782daf, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:33.693372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cae80a-e8e0-4336-9038-becfa87887d3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:33.728632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3f66c3db574fae8ae5760c508592c2', 'request_id': 'req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.747981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3f66c3db574fae8ae5760c508592c2', 'request_id': 'req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.780292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 951/1917] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:33 2022] PUT /identity/v3/projects/81df25c08f98400fb01509f2c83ae907/users/10f312a70f9b4252b33176fc3b782daf/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:33.782512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08778-bbc5-47e9-972b-8ec7de49bf09 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:33.782888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08778-bbc5-47e9-972b-8ec7de49bf09 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:33.783709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08778-bbc5-47e9-972b-8ec7de49bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:33.819621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-25c08778-bbc5-47e9-972b-8ec7de49bf09 None None] MFA Rules not processed for user `8ccc446ca35f4725b8e4e871336527c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:33.820937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-25c08778-bbc5-47e9-972b-8ec7de49bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.858668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3f66c3db574fae8ae5760c508592c2', 'request_id': 'req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.894905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] The token cache is being invalidate because project ef3f66c3db574fae8ae5760c508592c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:33.895274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.898184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:33.911860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 967/1918] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:33 2022] DELETE /identity/v3/projects/ef3f66c3db574fae8ae5760c508592c2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:33.911964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 952/1919] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:33.912055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:33.912140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08778-bbc5-47e9-972b-8ec7de49bf09 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:33.912234 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:33.989872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ff4a0-77dd-4422-a065-6ade4e2d3c6f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.011140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08778-bbc5-47e9-972b-8ec7de49bf09 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.018129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.018813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.019103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.019430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.020140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:34.022161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:34.042003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 953/1920] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:34.043913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:34.046010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.065151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83620-13e9-462a-8ddc-6a99b0bbbb6d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.072191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.072191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.072191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.072191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] PATH_INFO: `/v3/projects/f6e6a5e2951b42cc8cd26925d87e3328` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.072689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.072689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.072689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.072689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] PATH_INFO: `/v3/projects/a5afeefca37e4202b0159c2ff4268b0a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.073363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5afeefca37e4202b0159c2ff4268b0a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:34.076403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:34.080763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e6a5e2951b42cc8cd26925d87e3328)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:34.083062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:34.193491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5afeefca37e4202b0159c2ff4268b0a', 'request_id': 'req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.201904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5afeefca37e4202b0159c2ff4268b0a', 'request_id': 'req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.208717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5afeefca37e4202b0159c2ff4268b0a', 'request_id': 'req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.213738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e6a5e2951b42cc8cd26925d87e3328', 'request_id': 'req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.219260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e6a5e2951b42cc8cd26925d87e3328', 'request_id': 'req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.307921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] The token cache is being invalidate because project a5afeefca37e4202b0159c2ff4268b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:34.308476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.309057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5bc7eda1-0495-42ae-a87f-b7725b5b1e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.311038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 954/1921] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:34 2022] DELETE /identity/v3/projects/a5afeefca37e4202b0159c2ff4268b0a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:34.312176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.312558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.313467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.338591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:34.340197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.384971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e6a5e2951b42cc8cd26925d87e3328', 'request_id': 'req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.408759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] The token cache is being invalidate because project f6e6a5e2951b42cc8cd26925d87e3328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:34.409438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.410481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:34.412788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 968/1922] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:33 2022] DELETE /identity/v3/projects/f6e6a5e2951b42cc8cd26925d87e3328 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:34.414724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:34.416968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.420798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 955/1923] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:34.432540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:34.432540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.433333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308dfa5-9a16-4d5f-b79b-4b7668fc7b24 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.442068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed524f-24c0-4e89-9abc-5517e93025f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.443522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed524f-24c0-4e89-9abc-5517e93025f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.444460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed524f-24c0-4e89-9abc-5517e93025f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.445150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed524f-24c0-4e89-9abc-5517e93025f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.446139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed524f-24c0-4e89-9abc-5517e93025f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:34.446685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4bb26-c848-4855-8b54-2206cad791ab None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.448726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed524f-24c0-4e89-9abc-5517e93025f2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:34.452942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e500a48-729b-46a0-bcbf-8893e54d8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.456728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e500a48-729b-46a0-bcbf-8893e54d8909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.456728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e500a48-729b-46a0-bcbf-8893e54d8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.456728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e500a48-729b-46a0-bcbf-8893e54d8909 admin admin] PATH_INFO: `/v3/projects/81df25c08f98400fb01509f2c83ae907/users/10f312a70f9b4252b33176fc3b782daf/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.458609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e500a48-729b-46a0-bcbf-8893e54d8909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81df25c08f98400fb01509f2c83ae907, user_id=10f312a70f9b4252b33176fc3b782daf, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:34.461644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e500a48-729b-46a0-bcbf-8893e54d8909 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:34.474709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 956/1924] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:34 2022] PUT /identity/v3/projects/81df25c08f98400fb01509f2c83ae907/users/10f312a70f9b4252b33176fc3b782daf/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:34.479252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f66ff6-c837-46b8-9d2e-221fae0389b9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.479252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f66ff6-c837-46b8-9d2e-221fae0389b9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.479252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f66ff6-c837-46b8-9d2e-221fae0389b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-48f66ff6-c837-46b8-9d2e-221fae0389b9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:34.493034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:34.494435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:23:34.498071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 957/1925] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:34.499532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1510-e3fa-452a-ad47-10be0cf6996b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.504762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1510-e3fa-452a-ad47-10be0cf6996b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.504762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1510-e3fa-452a-ad47-10be0cf6996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.545123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-aa6d1510-e3fa-452a-ad47-10be0cf6996b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:34.546707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aa6d1510-e3fa-452a-ad47-10be0cf6996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.572842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 969/1926] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:34.575990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f4b9d-0f47-42f2-ad73-421345161a57 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.575990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f4b9d-0f47-42f2-ad73-421345161a57 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.575990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f4b9d-0f47-42f2-ad73-421345161a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.599187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3e7f4b9d-0f47-42f2-ad73-421345161a57 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:34.604373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3e7f4b9d-0f47-42f2-ad73-421345161a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.666844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 958/1927] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:34.668348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b850ad3-a29b-482d-9155-a69ff3d4c0d7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.668691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b850ad3-a29b-482d-9155-a69ff3d4c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.668979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b850ad3-a29b-482d-9155-a69ff3d4c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.692012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 970/1928] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:34.693786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b9cb-ee74-40cb-98d5-e7d2a676d20a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.694145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b9cb-ee74-40cb-98d5-e7d2a676d20a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.694432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9b9cb-ee74-40cb-98d5-e7d2a676d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.695463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3b850ad3-a29b-482d-9155-a69ff3d4c0d7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:34.696755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3b850ad3-a29b-482d-9155-a69ff3d4c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.707191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 959/1929] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:34.713409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b850ad3-a29b-482d-9155-a69ff3d4c0d7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:34.724281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b850ad3-a29b-482d-9155-a69ff3d4c0d7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.729273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff99f78-d3b6-431e-bd1e-4df707a1fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.729953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99f78-d3b6-431e-bd1e-4df707a1fb4a admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.730262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99f78-d3b6-431e-bd1e-4df707a1fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.730847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99f78-d3b6-431e-bd1e-4df707a1fb4a admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.731532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff99f78-d3b6-431e-bd1e-4df707a1fb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:34.733639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff99f78-d3b6-431e-bd1e-4df707a1fb4a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:34.744500 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:34.746969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-09e9b9cb-ee74-40cb-98d5-e7d2a676d20a None None] MFA Rules not processed for user `10f312a70f9b4252b33176fc3b782daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:34.748606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09e9b9cb-ee74-40cb-98d5-e7d2a676d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.833860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 960/1930] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:34.834057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f725-d961-4d64-9866-a99a8d8edaa5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.834219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f725-d961-4d64-9866-a99a8d8edaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.834569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f725-d961-4d64-9866-a99a8d8edaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.851102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 971/1931] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:34.870979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302418-b37a-44f9-992d-8d2741a9a136 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.871493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302418-b37a-44f9-992d-8d2741a9a136 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.873588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302418-b37a-44f9-992d-8d2741a9a136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.879048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8708f725-d961-4d64-9866-a99a8d8edaa5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:34.880444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8708f725-d961-4d64-9866-a99a8d8edaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.914064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 961/1932] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:34.915545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f725-d961-4d64-9866-a99a8d8edaa5 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:34.930195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f725-d961-4d64-9866-a99a8d8edaa5 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.940664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.942038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c3302418-b37a-44f9-992d-8d2741a9a136 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:34.942995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.943393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.943566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:34.944294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:34.945083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c3302418-b37a-44f9-992d-8d2741a9a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.946610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:34.949777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:34.955870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 972/1933] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:34.957114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302418-b37a-44f9-992d-8d2741a9a136 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:34.975180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 962/1934] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:34.976228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:34.978621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302418-b37a-44f9-992d-8d2741a9a136 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:34.979033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:34.996651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:34.997665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:34.998168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:34.999895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.002482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.005417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.018262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 973/1935] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:35.021694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.042102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f9c36-ad66-4fbb-a6cb-b2227a52b65d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.049671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.050216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.050664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.050951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.051712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:35.052034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.053969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.105256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 974/1936] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:35.106169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.120508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068eca-3762-4e1e-a7b9-53e98a20cb35 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.129691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.130549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.131526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.131834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.136386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a579-3dc9-4d7e-8d57-17434e0c02ef admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.152444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.153558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.154525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.155747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.156099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.156982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.157788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:35.158235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.160156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.169195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 963/1937] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:35.170231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.192584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21b3d6-d3ba-4f05-a047-0ebe3ba4c31c service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.194480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 975/1938] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:35.194480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.210117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.210902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.211191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.211472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.212331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.214310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.229130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1d2e-63c6-4c63-a2b5-2dfeed51f5f2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.255682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.255682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.255682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.255682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] PATH_INFO: `/v3/projects/a8e9eea7fac94264ae9755a217b7282a/users/2a828df0a94d4ff790ceb7089eb5e478/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.277924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e9eea7fac94264ae9755a217b7282a, user_id=2a828df0a94d4ff790ceb7089eb5e478, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.280888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.349640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 964/1939] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:35 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:35.350533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.364069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 976/1940] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:35 2022] PUT /identity/v3/projects/a8e9eea7fac94264ae9755a217b7282a/users/2a828df0a94d4ff790ceb7089eb5e478/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:35.364824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.481790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbafb-cb23-4e3d-afdb-edf6c740b609 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.499698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.502217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.502217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.502407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.508017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.510520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.576974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716833db-4c34-479a-9d34-f31f909990b9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.585225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.585959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.586245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.586524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.587233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.589471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.632226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 977/1941] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:35 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:35.632226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.668521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 965/1942] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:35 2022] POST /identity/v3/projects => generated 385 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:35.669587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:35.763497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbef958-f5d5-4940-ab4b-72ae7d7dca05 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.784747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd57fa-f4b1-4e57-bdb0-64a2eb293480 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:35.788998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.789854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.790267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.790699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.799838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:35.915217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:35.947538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.947947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:35.957260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:35.957260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:35.957631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.957744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:35.957744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:35.957744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:35.965989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 966/1943] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:35.966979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.002536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bc221-0430-47e2-8638-e8e2cb443953 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.011518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.012797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.013136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.013488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.014303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.016259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.029885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 967/1944] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:36.030750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.053093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:36.061284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fadbfb-0b03-4621-8dfd-87852644b271 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.070532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.071359 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.071736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.072132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.072906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.075478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.089637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 978/1945] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:35 2022] POST /identity/v3/users => generated 283 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:36.091539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.117112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8d5c9-e387-47a0-8a95-063c82c7896b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.123948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.124871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.127446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.127906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.128766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.132876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.239148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 979/1946] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:36 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:36.240065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.246495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 968/1947] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:36 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:36.247870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.253804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687512b-faf9-4bd3-977a-85b89f84f96b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.260158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.261521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.262590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.263513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] PATH_INFO: `/v3/projects/a8e9eea7fac94264ae9755a217b7282a/users/2a828df0a94d4ff790ceb7089eb5e478/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.267591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e9eea7fac94264ae9755a217b7282a, user_id=2a828df0a94d4ff790ceb7089eb5e478, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.273472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.285018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e61d3-adea-4cdb-8cc3-841304650cd3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.285018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.285018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.285018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.285660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.285660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.293844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.307893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 980/1948] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:36 2022] PUT /identity/v3/projects/a8e9eea7fac94264ae9755a217b7282a/users/2a828df0a94d4ff790ceb7089eb5e478/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:36.316006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.343089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 969/1949] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:36.343089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.361829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b5f3f-1b9c-455d-b062-64d3a7343fce admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.452825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496f2b-5ac8-452f-aae8-739e5702d407 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.464958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b6807-6027-4cf3-876d-a98d9caf74e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.464958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6807-6027-4cf3-876d-a98d9caf74e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.464958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6807-6027-4cf3-876d-a98d9caf74e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.464958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6807-6027-4cf3-876d-a98d9caf74e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.465329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b6807-6027-4cf3-876d-a98d9caf74e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.465591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b6807-6027-4cf3-876d-a98d9caf74e9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.475495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.476478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.477708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.478256 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.479670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.485966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.492372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 981/1950] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:36.492372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fc31b-72f5-4860-aff8-27e0dbee1658 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.492372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fc31b-72f5-4860-aff8-27e0dbee1658 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.492372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fc31b-72f5-4860-aff8-27e0dbee1658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.507669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 970/1951] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:36.509146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.528953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fb315-84b0-4a4f-a61a-733decca7321 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.542344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.543026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.543314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.543596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.544446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.547985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.551886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0b0fc31b-72f5-4860-aff8-27e0dbee1658 None None] MFA Rules not processed for user `2a828df0a94d4ff790ceb7089eb5e478`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:36.554529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0b0fc31b-72f5-4860-aff8-27e0dbee1658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:36.567914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 971/1952] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:36.570886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.591796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faf8f2-66cd-4bd3-a50a-37899273db62 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.601536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.602196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.603018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.603018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.603521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.605280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.622054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 972/1953] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:36.622054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.644142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd5ec9-ee6d-437e-bac7-def76a343529 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.664656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.666377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.667334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.667768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.668679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.676775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.702342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 973/1954] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:36.711129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.712654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 982/1955] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:36.713681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fc31b-72f5-4860-aff8-27e0dbee1658 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.733981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705ad45-4429-4aef-a1e2-5e47089bb545 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.737965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fc31b-72f5-4860-aff8-27e0dbee1658 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:36.746264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.747121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.747511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.747705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:36.748331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] PATH_INFO: `/v3/projects/4b465e5ba97c4f09a707acb40ef67aec/users/fc5e3db4d07f4de1862e777f0eb1b186/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.748597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:36.748902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:36.749189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] PATH_INFO: `/v3/projects/7b1dff693064432d94bddb52a45dd3f3/users/1c0704079b5e46b4a33c7569982ae322/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:36.774955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b465e5ba97c4f09a707acb40ef67aec, user_id=fc5e3db4d07f4de1862e777f0eb1b186, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.777970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.783714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1dff693064432d94bddb52a45dd3f3, user_id=1c0704079b5e46b4a33c7569982ae322, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:36.787404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:36.853133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 983/1956] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:36 2022] PUT /identity/v3/projects/4b465e5ba97c4f09a707acb40ef67aec/users/fc5e3db4d07f4de1862e777f0eb1b186/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:36.854392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 974/1957] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:36 2022] PUT /identity/v3/projects/7b1dff693064432d94bddb52a45dd3f3/users/1c0704079b5e46b4a33c7569982ae322/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:36.854717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:36.855220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:37.003655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517e384-3337-4e2d-95c2-6a24945ad72b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:37.003999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32a2c0-0339-442b-8792-d1581ff2919d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:37.008549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:37.009298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.009474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:37.009595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.009879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] PATH_INFO: `/v3/projects/386af82666c040e38482d29cf5027ad5/users/25e73ec0455b4c638779a870bdc3ecb4/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.010736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.011024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.011361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] PATH_INFO: `/v3/users/37fb78e504094a14b6d09f334b58aa5d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.012606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fb78e504094a14b6d09f334b58aa5d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:37.014783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:37.018671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:37.037060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386af82666c040e38482d29cf5027ad5, user_id=25e73ec0455b4c638779a870bdc3ecb4, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:37.042354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:37.054111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:37.099711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 975/1958] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:36 2022] PUT /identity/v3/projects/386af82666c040e38482d29cf5027ad5/users/25e73ec0455b4c638779a870bdc3ecb4/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:37.108475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:37.182919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb9949-7989-43a5-8ef0-bd5220ec47b9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:37.198312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f5cce-c72a-4cb0-88e7-e6c964392260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:37.198312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f5cce-c72a-4cb0-88e7-e6c964392260 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.198312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f5cce-c72a-4cb0-88e7-e6c964392260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.198312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f5cce-c72a-4cb0-88e7-e6c964392260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.240609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fb78e504094a14b6d09f334b58aa5d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:37.242822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fb78e504094a14b6d09f334b58aa5d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:37.283440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fb78e504094a14b6d09f334b58aa5d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:37.290550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fb78e504094a14b6d09f334b58aa5d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:37.302210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f5cce-c72a-4cb0-88e7-e6c964392260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:37.303835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f5cce-c72a-4cb0-88e7-e6c964392260 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:37.314651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 976/1959] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:37.315922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304f38-273a-4369-994b-144edb97c6d6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.316209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304f38-273a-4369-994b-144edb97c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.316485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304f38-273a-4369-994b-144edb97c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.358566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-58304f38-273a-4369-994b-144edb97c6d6 None None] MFA Rules not processed for user `fc5e3db4d07f4de1862e777f0eb1b186`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:37.360167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-58304f38-273a-4369-994b-144edb97c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.383412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-281d3ecd-d117-4478-8fd5-88882946ab63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fb78e504094a14b6d09f334b58aa5d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:37.393682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 984/1960] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:36 2022] DELETE /identity/v3/users/37fb78e504094a14b6d09f334b58aa5d => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:37.393682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb674-b820-4a24-974b-5cdbbc5a9f1a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.393682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb674-b820-4a24-974b-5cdbbc5a9f1a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.393682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb674-b820-4a24-974b-5cdbbc5a9f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.445192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-511fb674-b820-4a24-974b-5cdbbc5a9f1a None None] MFA Rules not processed for user `1c0704079b5e46b4a33c7569982ae322`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:37.446574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-511fb674-b820-4a24-974b-5cdbbc5a9f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.466680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 977/1961] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:37.468082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0625-456e-4183-a58a-02337a031b6b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.468445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0625-456e-4183-a58a-02337a031b6b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.469292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0625-456e-4183-a58a-02337a031b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.473759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:37.490841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c4ac0625-456e-4183-a58a-02337a031b6b None None] MFA Rules not processed for user `bc0247a0b7c64fa8800397a47b823931`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:37.492070 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c4ac0625-456e-4183-a58a-02337a031b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.560077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 985/1962] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:37.562314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.563472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.563943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.575819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 978/1963] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:37.577522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.577912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.579500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.602856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] MFA Rules not processed for user `25e73ec0455b4c638779a870bdc3ecb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:37.604359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.604800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:37.606228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.716903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 979/1964] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:37.718086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:37.720811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.740916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 986/1965] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:37.750031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:37.751835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.771649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433542-be2d-4a2d-b363-fc8d6fbf18b5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:37.776999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:37.780945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.780945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.780945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.780945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:37.783650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:37.793411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7038f-b6d7-4b54-8e88-becfb3aa66ba None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:37.799403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:37.800135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:37.800927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:37.803487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:37.803487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.814237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:37.911645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:37.913301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:37.913749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 987/1966] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:37 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:37.914603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:37.917398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:37.940965 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 980/1967] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:37.942813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:37.945619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:38.024273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe9228-c6de-4511-89a2-fdf3bc0554ae admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.031060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.032373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.032669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.032949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.034581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.036773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.044036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7a3c-81da-4757-91c3-533af257b922 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.108836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.110251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.110782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.111423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.122841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.124411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.137082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 981/1968] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:38.137941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.139471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:38.188604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 988/1969] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:37 2022] POST /identity/v3/projects => generated 365 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:38.189317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.243281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bfda7-f1dc-49ed-b5ed-2b29f297cc1e service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.310198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1d2e-36b7-4b13-a07c-1d6aa97b5590 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.321301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.322158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.322509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.322881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.323802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.325922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.340517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a24d3d-0f25-4fc1-b4a0-f47e86f70efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.341228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24d3d-0f25-4fc1-b4a0-f47e86f70efe service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.341514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24d3d-0f25-4fc1-b4a0-f47e86f70efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.341862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24d3d-0f25-4fc1-b4a0-f47e86f70efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.442990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a24d3d-0f25-4fc1-b4a0-f47e86f70efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.444728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a24d3d-0f25-4fc1-b4a0-f47e86f70efe service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.460490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 982/1970] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:38.461712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989333-011d-45e5-b6e7-cf430d031170 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.462235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989333-011d-45e5-b6e7-cf430d031170 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.462528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989333-011d-45e5-b6e7-cf430d031170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-49989333-011d-45e5-b6e7-cf430d031170 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:38.470927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:38.472075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:23:38.474296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 989/1971] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:38 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:38.477464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.482628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 983/1972] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:38 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:38.482628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49989333-011d-45e5-b6e7-cf430d031170 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.496336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945393b-ad84-4b4e-b64f-ad4723dc1853 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.511689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.512328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.512615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.512896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.513590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.517822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.544944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:38.549228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49989333-011d-45e5-b6e7-cf430d031170 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.554512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.555130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.555417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.555695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.556397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.558577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.573131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 984/1973] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:38.577698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.594005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ee2b-c329-4dd6-a927-914cfec6a8d7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.607607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 990/1974] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:38 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:38.608350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.609392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.610459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.610813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] PATH_INFO: `/v3/projects/09d7066bd522438d80b3467c8e7b7801/users/0a63e0c3dc944ee7b15add4c294603a6/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.613006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.640606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37168696-b874-4ca3-a6ee-447b052ff7cf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.661658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.662335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.662607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.662887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.664352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.668957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.671352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d7066bd522438d80b3467c8e7b7801, user_id=0a63e0c3dc944ee7b15add4c294603a6, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.692355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.708099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 991/1975] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:38.713149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.732364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c450-6731-4239-81b7-6c7c5c58f2d7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:38.740479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:38.741288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:38.741673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:38.742344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] PATH_INFO: `/v3/projects/d5d68573ac2f49e2bd7a158e502c2126/users/a248f0e7a2394415b38a0d5642030494/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:38.769497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d68573ac2f49e2bd7a158e502c2126, user_id=a248f0e7a2394415b38a0d5642030494, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:38.788511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 985/1976] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:38 2022] PUT /identity/v3/projects/09d7066bd522438d80b3467c8e7b7801/users/0a63e0c3dc944ee7b15add4c294603a6/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:38.791598 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.796366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:38.802091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:38.886713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 992/1977] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:38 2022] PUT /identity/v3/projects/d5d68573ac2f49e2bd7a158e502c2126/users/a248f0e7a2394415b38a0d5642030494/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:38.892930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:38.988042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:39.081836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425c84d-df6d-4ac7-b825-ff5f813f761c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:39.193966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa0a0-951f-4dc4-b07a-925d2bceab6a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:39.217619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:39.218782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.220643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.221133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.222842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:39.226408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:39.253129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 993/1978] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:39.253129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:39.271976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:39.276983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.276983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.276983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] PATH_INFO: `/v3/projects/239f35d821354aaab7adf16cec3ef557` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.277373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed326f6-f481-4a9b-86df-b4294e414a8f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:39.277495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=239f35d821354aaab7adf16cec3ef557)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:39.277495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:39.284738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:39.285157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.285486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.285842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.286601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:39.288718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:39.302180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 994/1979] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:39.302899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:39.329098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa961-0a4d-404b-ba49-8ba3406cf4dc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:39.346546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:39.347841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.348264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.349563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] PATH_INFO: `/v3/projects/09d7066bd522438d80b3467c8e7b7801/users/0a63e0c3dc944ee7b15add4c294603a6/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.352229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d7066bd522438d80b3467c8e7b7801, user_id=0a63e0c3dc944ee7b15add4c294603a6, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:39.356413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:39.398228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 995/1980] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:39 2022] PUT /identity/v3/projects/09d7066bd522438d80b3467c8e7b7801/users/0a63e0c3dc944ee7b15add4c294603a6/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:39.403046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:39.511412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239f35d821354aaab7adf16cec3ef557', 'request_id': 'req-8b9edffd-7906-409a-ac7a-ab29db6408fa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:39.524096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239f35d821354aaab7adf16cec3ef557', 'request_id': 'req-8b9edffd-7906-409a-ac7a-ab29db6408fa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:39.541160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239f35d821354aaab7adf16cec3ef557', 'request_id': 'req-8b9edffd-7906-409a-ac7a-ab29db6408fa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:39.559008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fe45b-ffd1-4c94-82c7-4c4ad4e3cb92 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:39.638676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:39.639725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.640008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.640287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] PATH_INFO: `/v3/projects/d5d68573ac2f49e2bd7a158e502c2126/users/a248f0e7a2394415b38a0d5642030494/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.643263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d68573ac2f49e2bd7a158e502c2126, user_id=a248f0e7a2394415b38a0d5642030494, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:39.645974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:39.647508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] The token cache is being invalidate because project 239f35d821354aaab7adf16cec3ef557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:39.647874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:39.649831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b9edffd-7906-409a-ac7a-ab29db6408fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:39.650557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 986/1981] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:38 2022] DELETE /identity/v3/projects/239f35d821354aaab7adf16cec3ef557 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:39.654938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80aa35-74b9-4bd2-bd1a-0a4c34bd161f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.655361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80aa35-74b9-4bd2-bd1a-0a4c34bd161f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.655642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80aa35-74b9-4bd2-bd1a-0a4c34bd161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.658503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 996/1982] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:39 2022] PUT /identity/v3/projects/d5d68573ac2f49e2bd7a158e502c2126/users/a248f0e7a2394415b38a0d5642030494/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:39.659559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:39.662967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:39.685343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cd80aa35-74b9-4bd2-bd1a-0a4c34bd161f None None] MFA Rules not processed for user `0a63e0c3dc944ee7b15add4c294603a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:39.686663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cd80aa35-74b9-4bd2-bd1a-0a4c34bd161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:39.749117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d1b50-bfe4-4e0b-a0fa-d165be721135 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:39.755219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:39.755964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.756321 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.756782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] PATH_INFO: `/v3/users/10f312a70f9b4252b33176fc3b782daf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.758116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f312a70f9b4252b33176fc3b782daf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:39.761014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:39.790035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 987/1983] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:39.791796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.792314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.792901 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:39.802885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:39.833758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] MFA Rules not processed for user `a248f0e7a2394415b38a0d5642030494`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:39.835100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:39.921218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 988/1984] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:39.922792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:39.927649 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:39.991753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e639f-5499-46c9-9923-88427c620176 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:39.995717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:39.996341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:39.996617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:39.996891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:40.007934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:40.009365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:40.016563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f312a70f9b4252b33176fc3b782daf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.017429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f312a70f9b4252b33176fc3b782daf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.020734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 989/1985] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:40.021582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:40.023117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:40.035538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf8925-1ab2-49e4-bc3b-4da1c1b4a20a service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:40.040084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:40.040702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:40.040984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:40.041258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:40.042208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f312a70f9b4252b33176fc3b782daf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.053985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f312a70f9b4252b33176fc3b782daf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.057865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:40.059693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:40.082136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 990/1986] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:40.083671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:40.085531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:40.108801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc341c-063b-4db1-a270-e763394fa129 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:40.117046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:40.117705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:40.118010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:40.118287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] PATH_INFO: `/v3/users/fc5e3db4d07f4de1862e777f0eb1b186` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:40.119889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5e3db4d07f4de1862e777f0eb1b186)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:40.121908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:40.155679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f312a70f9b4252b33176fc3b782daf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.164742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 997/1987] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:39 2022] DELETE /identity/v3/users/10f312a70f9b4252b33176fc3b782daf => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:40.344614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:40.346168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:40.355676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:40.372651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5e3db4d07f4de1862e777f0eb1b186'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.373294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5e3db4d07f4de1862e777f0eb1b186'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.394449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5e3db4d07f4de1862e777f0eb1b186'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.455189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ca690-71d2-44d8-bd60-5cebddf2314e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:40.470501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5e3db4d07f4de1862e777f0eb1b186'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.477168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-abcc5cdf-0e9b-4bb9-a98a-d4cbb70acc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5e3db4d07f4de1862e777f0eb1b186'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:40.477463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:40.478450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:40.478939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:40.479698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:40.483335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:40.505031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 991/1988] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:40 2022] DELETE /identity/v3/users/fc5e3db4d07f4de1862e777f0eb1b186 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:40.509708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:40.510097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:40.510422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:40.553570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:40.554890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:40.718561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 992/1989] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:40.719648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:40.723647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:40.767740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 998/1990] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:23:40.780810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:40.783188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:40.915643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bce13-e00e-45c0-8f4e-a18c0604a717 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:40.919901 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79a79-51f6-4e48-a7fa-2bb8fed04821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:40.920733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79a79-51f6-4e48-a7fa-2bb8fed04821 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:40.921258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79a79-51f6-4e48-a7fa-2bb8fed04821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:40.921654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79a79-51f6-4e48-a7fa-2bb8fed04821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:40.935973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed79a79-51f6-4e48-a7fa-2bb8fed04821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:40.938446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed79a79-51f6-4e48-a7fa-2bb8fed04821 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:40.951079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 993/1991] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:41.001952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:41.003405 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:41.097134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ccfa3-8506-4c38-90a7-5ae0664e4ef7 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:41.103276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:41.104328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:41.104814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:41.105233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] PATH_INFO: `/v3/projects/81df25c08f98400fb01509f2c83ae907` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:41.107449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81df25c08f98400fb01509f2c83ae907)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:41.110310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:41.264661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81df25c08f98400fb01509f2c83ae907', 'request_id': 'req-694b217e-ac91-405a-b90a-f171cf1ff9b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.272620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81df25c08f98400fb01509f2c83ae907', 'request_id': 'req-694b217e-ac91-405a-b90a-f171cf1ff9b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.352149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81df25c08f98400fb01509f2c83ae907', 'request_id': 'req-694b217e-ac91-405a-b90a-f171cf1ff9b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.375008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] The token cache is being invalidate because project 81df25c08f98400fb01509f2c83ae907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:41.375573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.377805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-694b217e-ac91-405a-b90a-f171cf1ff9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.382661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 999/1992] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:41 2022] DELETE /identity/v3/projects/81df25c08f98400fb01509f2c83ae907 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:41.387539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f2ba-08e8-42a8-983c-e4fd9ed566c6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:41.387833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f2ba-08e8-42a8-983c-e4fd9ed566c6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:41.388114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4f2ba-08e8-42a8-983c-e4fd9ed566c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:41.441648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-faa4f2ba-08e8-42a8-983c-e4fd9ed566c6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:41.442986 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-faa4f2ba-08e8-42a8-983c-e4fd9ed566c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:41.576255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 994/1993] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:41.592838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf200-566e-419b-8fa4-1c40d32f7b6a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:41.593193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf200-566e-419b-8fa4-1c40d32f7b6a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:41.593440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf200-566e-419b-8fa4-1c40d32f7b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:41.631971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-629cf200-566e-419b-8fa4-1c40d32f7b6a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:41.633296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-629cf200-566e-419b-8fa4-1c40d32f7b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:41.643833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1000/1994] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:41.648267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4f2ba-08e8-42a8-983c-e4fd9ed566c6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:41.659174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4f2ba-08e8-42a8-983c-e4fd9ed566c6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:41.663915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:41.664530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:41.664818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:41.665097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:41.666169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:41.666169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:41.667885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:41.680526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 995/1995] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:41.685591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cf200-566e-419b-8fa4-1c40d32f7b6a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:41.697491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:41.704222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cf200-566e-419b-8fa4-1c40d32f7b6a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:41.705041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:41.720040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:41.726260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:41.726260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:41.726260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:41.726260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:41.726260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:41.726785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692550cf-37b9-4f91-a33e-f2958a287511 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:41.732533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:41.733494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:41.734040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:41.734599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] PATH_INFO: `/v3/projects/4b465e5ba97c4f09a707acb40ef67aec` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:41.736727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b465e5ba97c4f09a707acb40ef67aec)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:41.739137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:41.773059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:41.866340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1001/1996] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:41 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:41.867494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:41.870353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:41.895183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b465e5ba97c4f09a707acb40ef67aec', 'request_id': 'req-96fa521d-5388-475d-aee9-95555505532f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.902471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b465e5ba97c4f09a707acb40ef67aec', 'request_id': 'req-96fa521d-5388-475d-aee9-95555505532f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.909543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b465e5ba97c4f09a707acb40ef67aec', 'request_id': 'req-96fa521d-5388-475d-aee9-95555505532f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.943444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f72890-d9d8-488d-b7d8-d01fe1b51bf3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:41.991174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] The token cache is being invalidate because project 4b465e5ba97c4f09a707acb40ef67aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:41.991790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.992742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:41.995044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 996/1997] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:41 2022] DELETE /identity/v3/projects/4b465e5ba97c4f09a707acb40ef67aec => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:41.996276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:41.998158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:42.043123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:42.044434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.044781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.045061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] PATH_INFO: `/v3/users/f5a85438fda6446fa7d9b31da11d539b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.046330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a85438fda6446fa7d9b31da11d539b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:42.049215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:42.082431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa521d-5388-475d-aee9-95555505532f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:42.087170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:42.087784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.088067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.088342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.089000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:42.091060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:42.189382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 997/1998] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:41 2022] POST /identity/v3/users => generated 281 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:42.190270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:42.191944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:42.204367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1a00e-0026-4717-ac43-4725bba75428 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:42.217073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:42.217757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.218050 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.218334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] PATH_INFO: `/v3/users/0a63e0c3dc944ee7b15add4c294603a6` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.220149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a63e0c3dc944ee7b15add4c294603a6)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:42.222115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:42.224506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a85438fda6446fa7d9b31da11d539b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.225497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a85438fda6446fa7d9b31da11d539b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.239837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a85438fda6446fa7d9b31da11d539b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.247263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a85438fda6446fa7d9b31da11d539b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.378077 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:42.463345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a85438fda6446fa7d9b31da11d539b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.470438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1002/1999] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:41 2022] DELETE /identity/v3/users/f5a85438fda6446fa7d9b31da11d539b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:42.471060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:42.472444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:42.530110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a63e0c3dc944ee7b15add4c294603a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.530838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a63e0c3dc944ee7b15add4c294603a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.539708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633262cc-fe55-4539-aac0-3520e42eb8e8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:42.544556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:42.545188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.545513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.545773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.546480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:42.546604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a63e0c3dc944ee7b15add4c294603a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.548825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:42.561686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1003/2000] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:42.566651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:42.578103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad5d87-9e01-41ab-8dcb-e6f328fea245 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:42.583660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:42.584277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.584592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.587227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.587227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:42.587383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:42.598141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1004/2001] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:42.602281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:42.620080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d615a1-4a4c-4449-be89-cbfcb4fb319e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:42.622220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:42.623257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.623597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.623886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] PATH_INFO: `/v3/projects/56bee7b4646c4ec9b1906e98801e7c8b/users/2601d3d4177f4338a4b1fb682d370125/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.643290 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bee7b4646c4ec9b1906e98801e7c8b, user_id=2601d3d4177f4338a4b1fb682d370125, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:42.646516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a63e0c3dc944ee7b15add4c294603a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.647169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c0c7430c-463b-40ea-bf43-511bdf1f7d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a63e0c3dc944ee7b15add4c294603a6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:42.654199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:42.689880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 998/2002] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:42 2022] DELETE /identity/v3/users/0a63e0c3dc944ee7b15add4c294603a6 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:42.755487 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1005/2003] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:42 2022] PUT /identity/v3/projects/56bee7b4646c4ec9b1906e98801e7c8b/users/2601d3d4177f4338a4b1fb682d370125/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:23:42.767264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.767566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.767850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.821576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:42.823671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:42.843323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] MFA Rules not processed for user `2601d3d4177f4338a4b1fb682d370125`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:42.851610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:42.943487 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269298-e1d0-4bbd-8f81-c7ff4d989e50 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:42.952945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:42.954658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:42.955228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:42.955553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] PATH_INFO: `/v3/projects/d9e1d12af7964fbbaea2eab3ed3d6847` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:42.957391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e1d12af7964fbbaea2eab3ed3d6847)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:42.958802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:42.961985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 999/2004] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:43.117113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e1d12af7964fbbaea2eab3ed3d6847', 'request_id': 'req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.126039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e1d12af7964fbbaea2eab3ed3d6847', 'request_id': 'req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.195107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e1d12af7964fbbaea2eab3ed3d6847', 'request_id': 'req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.204671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:43.206561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.210051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] The token cache is being invalidate because project d9e1d12af7964fbbaea2eab3ed3d6847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:43.210349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.211023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-be0b657f-68a3-4e0f-84cb-3c48c801e8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.212576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1006/2005] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:42 2022] DELETE /identity/v3/projects/d9e1d12af7964fbbaea2eab3ed3d6847 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:43.217110 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.217426 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.218159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.239253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:43.244263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.271390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01c29-8c3b-4914-a9e3-c80d6229ed7e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:43.310421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1007/2006] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:43.311280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:43.313202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.341311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03747681-9e63-4ab6-8be5-207a5833415b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:43.342641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9908ab-c9c0-4946-9278-adacd10518fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:43.343529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9908ab-c9c0-4946-9278-adacd10518fb service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.344631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9908ab-c9c0-4946-9278-adacd10518fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.345790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9908ab-c9c0-4946-9278-adacd10518fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.348065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3f9908ab-c9c0-4946-9278-adacd10518fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.352955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:43.354003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.354003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.354227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] PATH_INFO: `/v3/projects/09d7066bd522438d80b3467c8e7b7801` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.355824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d7066bd522438d80b3467c8e7b7801)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:43.358894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:43.422517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9908ab-c9c0-4946-9278-adacd10518fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:43.423953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9908ab-c9c0-4946-9278-adacd10518fb service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:43.433475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1000/2007] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:23:43.439345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.439575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.439858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.463201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:43.464574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.473063 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1001/2008] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:43.474083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:43.475624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.487517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65dc1-100e-4d64-9885-1f103178bba7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:43.492169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:43.492802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.493087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.493363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] PATH_INFO: `/v3/users/2601d3d4177f4338a4b1fb682d370125` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.494817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2601d3d4177f4338a4b1fb682d370125)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:43.496717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:43.583877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d7066bd522438d80b3467c8e7b7801', 'request_id': 'req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.589441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d7066bd522438d80b3467c8e7b7801', 'request_id': 'req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.708686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d7066bd522438d80b3467c8e7b7801', 'request_id': 'req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.723235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] The token cache is being invalidate because project 09d7066bd522438d80b3467c8e7b7801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:43.723235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.724526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.726907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1008/2009] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:43 2022] DELETE /identity/v3/projects/09d7066bd522438d80b3467c8e7b7801 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:43.727260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:43.728645 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.758046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2601d3d4177f4338a4b1fb682d370125'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.759800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2601d3d4177f4338a4b1fb682d370125'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.774336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2601d3d4177f4338a4b1fb682d370125'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.834523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c66c-2e0c-46c5-a674-eedfe0e27b5a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:43.834869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2601d3d4177f4338a4b1fb682d370125'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.835797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-98770cad-6faa-43f9-87c7-a577faa7a929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2601d3d4177f4338a4b1fb682d370125'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:43.839508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d5351-737c-430e-bfef-60d2d6a93707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:43.840227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d5351-737c-430e-bfef-60d2d6a93707 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.840520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d5351-737c-430e-bfef-60d2d6a93707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.840820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d5351-737c-430e-bfef-60d2d6a93707 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.841707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d5351-737c-430e-bfef-60d2d6a93707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:43.842062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d5351-737c-430e-bfef-60d2d6a93707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:43.847571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d5351-737c-430e-bfef-60d2d6a93707 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:43.856008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1002/2010] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:43 2022] DELETE /identity/v3/users/2601d3d4177f4338a4b1fb682d370125 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:43.857741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b372f-d4f9-4e8a-b78a-303fc1c74058 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.858017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b372f-d4f9-4e8a-b78a-303fc1c74058 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.858479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b372f-d4f9-4e8a-b78a-303fc1c74058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.869811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1009/2011] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:43.871712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.872214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.872703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.892056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cd5b372f-d4f9-4e8a-b78a-303fc1c74058 None None] MFA Rules not processed for user `bc0247a0b7c64fa8800397a47b823931`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:43.893296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cd5b372f-d4f9-4e8a-b78a-303fc1c74058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.894071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:43.895298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.957827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1003/2012] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:43.959265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e686e5-b8ec-4378-a4e5-1b46df12cdc5 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.959630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e686e5-b8ec-4378-a4e5-1b46df12cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.960049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e686e5-b8ec-4378-a4e5-1b46df12cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:43.971649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1010/2013] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:43.972600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:43.974101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.981011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f4e686e5-b8ec-4378-a4e5-1b46df12cdc5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:43.982261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f4e686e5-b8ec-4378-a4e5-1b46df12cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:43.987065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9301706-17f8-4db4-9f7a-3a044ffdb2ad None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:43.992114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1004/2014] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:43.993555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:43.994217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:43.994503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.005708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.006637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.007085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.007570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.011546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.013866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.018355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:44.019981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:44.028614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1005/2015] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:44.029741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.033184 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:44.101633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bbec6-9d45-4055-ab6b-a47b1081dae6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.107051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.107751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.108042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.108323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.118769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.120689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.132335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1006/2016] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:44.133571 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.142882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a73c-ce67-43d2-911c-7f1282222552 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.149096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.149955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.150123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.150513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.151441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:44.151660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.152371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:44.153478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.164372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1011/2017] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:43 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:44.165593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.176542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1007/2018] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:44.177798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.188389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ac8d5-36e0-4a9d-bcbe-41276b82ad96 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.248309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7bf9-84ef-45ae-b199-b163c6e90bbe admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.255784 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.256962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.257461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.257952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.258819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.262012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.268887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85d5b-16ab-4868-94c6-d1f4f9294ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.269669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85d5b-16ab-4868-94c6-d1f4f9294ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.270487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85d5b-16ab-4868-94c6-d1f4f9294ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.270487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85d5b-16ab-4868-94c6-d1f4f9294ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.271152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85d5b-16ab-4868-94c6-d1f4f9294ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.273741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85d5b-16ab-4868-94c6-d1f4f9294ee0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.401249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1012/2019] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:44 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:44.402308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.404017 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:44.407072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1008/2020] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:44 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:44.409363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aeead-b2d2-404c-b734-6dfded3c7817 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.409868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aeead-b2d2-404c-b734-6dfded3c7817 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.410750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aeead-b2d2-404c-b734-6dfded3c7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.418639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c15dda-3473-497d-bdeb-34ff7e1d8fc5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-083aeead-b2d2-404c-b734-6dfded3c7817 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:23:44.423563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:23:44.424325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:23:44.425150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1009/2021] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:44 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:23:44.425150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aeead-b2d2-404c-b734-6dfded3c7817 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.499750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.500677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.501010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.501559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] PATH_INFO: `/v3/users/c37639a91d384e7789e1f52013fa77b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.503531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37639a91d384e7789e1f52013fa77b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.507197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.528271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aeead-b2d2-404c-b734-6dfded3c7817 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.534299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.535014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.535372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.535650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.536413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.538205 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.553886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1010/2022] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:44.554999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.566416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa76d7-b7bb-4806-b68e-be66dfccf686 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.571481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.572127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.572408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.572680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.573378 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.575380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.653087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:44.666661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1011/2023] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:44 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:44.667639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.678857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58204-dd5a-4900-a49d-a86193fd6dff admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.684744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.685496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.685822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.686092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.686787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.689577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.707952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1012/2024] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:44.707952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.717397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37639a91d384e7789e1f52013fa77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:44.717613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3af96-6bd0-48a0-80fd-7d9ff25619e5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.718194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37639a91d384e7789e1f52013fa77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:44.723002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.723626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.723912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.724191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.725016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.726707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.738741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37639a91d384e7789e1f52013fa77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:44.749375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37639a91d384e7789e1f52013fa77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:44.753516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1013/2025] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:44.754512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.769699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1ef32-e199-420d-b6e1-c2c51700d5a8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:44.781179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7df0b5-dec2-41dd-b36d-98745103c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:44.782240 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df0b5-dec2-41dd-b36d-98745103c317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.782498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df0b5-dec2-41dd-b36d-98745103c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.782754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df0b5-dec2-41dd-b36d-98745103c317 admin admin] PATH_INFO: `/v3/projects/0ec26e0ee1084cce84c20105cdcfe785/users/4fb3a69597164ab1969f734bee0f7167/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.811775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7df0b5-dec2-41dd-b36d-98745103c317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec26e0ee1084cce84c20105cdcfe785, user_id=4fb3a69597164ab1969f734bee0f7167, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:44.815544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7df0b5-dec2-41dd-b36d-98745103c317 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:44.829214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37639a91d384e7789e1f52013fa77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:44.838153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1013/2026] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:44 2022] DELETE /identity/v3/users/c37639a91d384e7789e1f52013fa77b6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:44.841513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:44.842545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:44.918154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1014/2027] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:44 2022] PUT /identity/v3/projects/0ec26e0ee1084cce84c20105cdcfe785/users/4fb3a69597164ab1969f734bee0f7167/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:44.919998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:44.926005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:44.926005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:44.954747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:44.956297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:44.961812 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fb574-4b89-462a-a0ae-5be7f09ca8c8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.036802 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1015/2028] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:45.037034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e4d0-d027-4e95-954b-f7772a863e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.037151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.037240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e4d0-d027-4e95-954b-f7772a863e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.037240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e4d0-d027-4e95-954b-f7772a863e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.037240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e4d0-d027-4e95-954b-f7772a863e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.037478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.043421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57e4d0-d027-4e95-954b-f7772a863e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.045332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57e4d0-d027-4e95-954b-f7772a863e9d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.053266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cb6ca-6ed3-47d5-8a86-0567c0bb3147 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.057927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1014/2029] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:45.058638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2055f-a931-419a-9225-643889330414 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.059006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2055f-a931-419a-9225-643889330414 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.059514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2055f-a931-419a-9225-643889330414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.063988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.064701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.065040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.065329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] PATH_INFO: `/v3/projects/56bee7b4646c4ec9b1906e98801e7c8b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.066593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bee7b4646c4ec9b1906e98801e7c8b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.069109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.092970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9ae2055f-a931-419a-9225-643889330414 None None] MFA Rules not processed for user `4fb3a69597164ab1969f734bee0f7167`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:45.094555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9ae2055f-a931-419a-9225-643889330414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.166886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1015/2030] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:45.168419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2055f-a931-419a-9225-643889330414 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.170487 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9ae2055f-a931-419a-9225-643889330414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.236109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2055f-a931-419a-9225-643889330414 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.240474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.241152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.241444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.241745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.253040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.254602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.256785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bee7b4646c4ec9b1906e98801e7c8b', 'request_id': 'req-a717666d-b060-4225-a3b8-8502d2fd954c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:45.265602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bee7b4646c4ec9b1906e98801e7c8b', 'request_id': 'req-a717666d-b060-4225-a3b8-8502d2fd954c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:45.267642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1016/2031] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:45.275943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bee7b4646c4ec9b1906e98801e7c8b', 'request_id': 'req-a717666d-b060-4225-a3b8-8502d2fd954c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:45.276245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.294367 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625beeab-7849-4888-bacd-d1d6a445475b service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.371454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194855f-61c7-402c-89ac-a419e667a697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.372586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194855f-61c7-402c-89ac-a419e667a697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.373025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194855f-61c7-402c-89ac-a419e667a697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.374316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194855f-61c7-402c-89ac-a419e667a697 admin admin] PATH_INFO: `/v3/projects/df5f4c2e3fc44140b4ab62eedbc9017b/users/1fa2115e0b1846b2ab1efc8fb3eb04cb/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.394868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194855f-61c7-402c-89ac-a419e667a697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5f4c2e3fc44140b4ab62eedbc9017b, user_id=1fa2115e0b1846b2ab1efc8fb3eb04cb, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.397634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194855f-61c7-402c-89ac-a419e667a697 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.411466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] The token cache is being invalidate because project 56bee7b4646c4ec9b1906e98801e7c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:45.411816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:45.412516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:45.417623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1016/2032] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:45 2022] DELETE /identity/v3/projects/56bee7b4646c4ec9b1906e98801e7c8b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:45.418543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.419947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.486748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1017/2033] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:45 2022] PUT /identity/v3/projects/df5f4c2e3fc44140b4ab62eedbc9017b/users/1fa2115e0b1846b2ab1efc8fb3eb04cb/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:45.497649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284fd7c-3c14-4249-8d17-b273cfa0a436 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.498070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284fd7c-3c14-4249-8d17-b273cfa0a436 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.498391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284fd7c-3c14-4249-8d17-b273cfa0a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.519918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717666d-b060-4225-a3b8-8502d2fd954c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.528310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2284fd7c-3c14-4249-8d17-b273cfa0a436 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:45.529555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2284fd7c-3c14-4249-8d17-b273cfa0a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.606651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1018/2034] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:45.608069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db101e-9d09-4740-9a93-e15af0b3a287 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.608425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db101e-9d09-4740-9a93-e15af0b3a287 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.608776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db101e-9d09-4740-9a93-e15af0b3a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.622455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.622455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.622455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.622455 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.626051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.649359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-60db101e-9d09-4740-9a93-e15af0b3a287 None None] MFA Rules not processed for user `1fa2115e0b1846b2ab1efc8fb3eb04cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:45.650790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60db101e-9d09-4740-9a93-e15af0b3a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.654511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:45.731552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1019/2035] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:45.733175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.733322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8849e-71b8-4549-8e3c-cf49c4333a85 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.733461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8849e-71b8-4549-8e3c-cf49c4333a85 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.733881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8849e-71b8-4549-8e3c-cf49c4333a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.736174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.751350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1017/2036] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:45.752307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.754890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.759545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d4b8849e-71b8-4549-8e3c-cf49c4333a85 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:45.760875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d4b8849e-71b8-4549-8e3c-cf49c4333a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.782978 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1020/2037] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:45.785888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1331d-11cc-444d-8b9b-0f9f10bbce47 service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.786999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8849e-71b8-4549-8e3c-cf49c4333a85 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.791013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.791746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.792309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.792710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.793496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.795573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.801842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8849e-71b8-4549-8e3c-cf49c4333a85 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.810402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.811039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.811461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.811752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.812506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:45.813652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.815385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.831347 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1021/2038] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:23:45.832798 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.842716 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4841-0f3d-43ce-aa7e-6f8a5b303994 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:45.850305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:45.851045 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:45.851333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:45.851612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:45.852508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:45.854671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:45.915157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1018/2039] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:45 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:45.915157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:45.915157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:45.965769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1022/2040] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:45 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:45.965769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.029961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:46.046198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c138-df81-46d9-9b66-faaaad877a0d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.064089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892c3d5-6242-4c47-be51-bd10fd0c09bb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.070543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.071205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.071473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.071758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.072437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.078363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.115497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.116075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.116360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.116643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] PATH_INFO: `/v3/projects/db60edcc98cb406ab72225cdfcdd8236` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.117951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db60edcc98cb406ab72225cdfcdd8236)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.120213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.150455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1023/2041] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:45 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:46.150893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.163467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d64fc3-cd6c-4459-b770-1b8acac4825a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.168383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.169012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.169425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.169740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.170416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.173849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.227612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db60edcc98cb406ab72225cdfcdd8236', 'request_id': 'req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.235534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db60edcc98cb406ab72225cdfcdd8236', 'request_id': 'req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.248801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1024/2042] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:46 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:46.248984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.260163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db60edcc98cb406ab72225cdfcdd8236', 'request_id': 'req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.260920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4ca37-e8d2-4b9c-bb93-b68b9fc96325 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.332917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.333544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.342062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.342062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.342062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.342062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.349423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1025/2043] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:46.350317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.362535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4890-d7ee-43e3-8855-3d37569de63f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.363173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:46.370683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] The token cache is being invalidate because project db60edcc98cb406ab72225cdfcdd8236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:46.370683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.370683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.371339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.371953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.372827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.373114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.373516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1019/2044] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:45 2022] DELETE /identity/v3/projects/db60edcc98cb406ab72225cdfcdd8236 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:46.373861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.376248 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.378002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.380885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:46.388686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1026/2045] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:46.390037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.394003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:46.402090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98ea58-bb87-45ad-ad71-5e9bb28c4a4f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.409662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694fc1-bb2c-48e8-a34f-6a8c8ae6833d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.414415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.415808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.416508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.416693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.416802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.417062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] PATH_INFO: `/v3/users/8ccc446ca35f4725b8e4e871336527c6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.417457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.418737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] PATH_INFO: `/v3/projects/c962842b243c4dbbabc13b197dbd703c/users/42c8f949b0ad4b2b8d0ce1f55e9931d6/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.418853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ccc446ca35f4725b8e4e871336527c6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.421361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.460886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c962842b243c4dbbabc13b197dbd703c, user_id=42c8f949b0ad4b2b8d0ce1f55e9931d6, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.463941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.569599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1020/2046] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:46 2022] PUT /identity/v3/projects/c962842b243c4dbbabc13b197dbd703c/users/42c8f949b0ad4b2b8d0ce1f55e9931d6/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:46.569599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.572127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:46.638447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ccc446ca35f4725b8e4e871336527c6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.639077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ccc446ca35f4725b8e4e871336527c6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.645755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5a11-5984-4d9d-98b6-ab92604b1c3e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.650570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.651168 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.651484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.651766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.652459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.653205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ccc446ca35f4725b8e4e871336527c6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.654131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.663954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ccc446ca35f4725b8e4e871336527c6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.667291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1021/2047] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:46.668156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.678947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc800d-7263-45ff-8603-6352647aa5f9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.685170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.685820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.686111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.686395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.687098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.688977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.700672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1022/2048] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:46.701572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.720155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4307-ea4c-4fb7-a372-ef7c9bbd755b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.725413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925cf7b-259b-49d4-bf6c-0acd0e4711f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.726190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925cf7b-259b-49d4-bf6c-0acd0e4711f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.726792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925cf7b-259b-49d4-bf6c-0acd0e4711f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.727085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925cf7b-259b-49d4-bf6c-0acd0e4711f7 admin admin] PATH_INFO: `/v3/projects/0b3ef7814ea345c2a233b7653828e2b3/users/6c284a01207b423799642935e6d355f7/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.738720 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ccc446ca35f4725b8e4e871336527c6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:46.746265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1027/2049] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:46 2022] DELETE /identity/v3/users/8ccc446ca35f4725b8e4e871336527c6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:46.747201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:46.750187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:46.753911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925cf7b-259b-49d4-bf6c-0acd0e4711f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3ef7814ea345c2a233b7653828e2b3, user_id=6c284a01207b423799642935e6d355f7, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.756907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925cf7b-259b-49d4-bf6c-0acd0e4711f7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.880137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e29d26-9ed6-479d-80ca-f44eaf8226a0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:46.889182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec787934-b6fd-443e-a938-7b778010354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:46.889182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787934-b6fd-443e-a938-7b778010354a admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.889182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787934-b6fd-443e-a938-7b778010354a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.889182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787934-b6fd-443e-a938-7b778010354a admin admin] PATH_INFO: `/v3/projects/c962842b243c4dbbabc13b197dbd703c/users/42c8f949b0ad4b2b8d0ce1f55e9931d6/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.890964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec787934-b6fd-443e-a938-7b778010354a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c962842b243c4dbbabc13b197dbd703c, user_id=42c8f949b0ad4b2b8d0ce1f55e9931d6, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:46.893822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec787934-b6fd-443e-a938-7b778010354a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:46.906061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1028/2050] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:46 2022] PUT /identity/v3/projects/c962842b243c4dbbabc13b197dbd703c/users/42c8f949b0ad4b2b8d0ce1f55e9931d6/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:46.915572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1023/2051] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:46 2022] PUT /identity/v3/projects/0b3ef7814ea345c2a233b7653828e2b3/users/6c284a01207b423799642935e6d355f7/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:46.918023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.918824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.918824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.927913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:46.928277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:46.928628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:46.958653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] MFA Rules not processed for user `42c8f949b0ad4b2b8d0ce1f55e9931d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:46.959890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:46.966860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] MFA Rules not processed for user `6c284a01207b423799642935e6d355f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:46.968246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:47.104943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1029/2052] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:47.106101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1024/2053] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:47.123731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:47.125829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:47.127492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:47.130505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:47.230380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda6aa3-b11c-4618-bef6-930cbdc11f15 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:47.240794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90da5ec-5a06-4ae8-a7b3-17a08f0c4960 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:47.243592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:47.244764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:47.245058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:47.245388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:47.246557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adb0143db64ca68f9c3846951adb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:47.247364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:47.247906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:47.248332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:47.258927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:47.260974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:47.273652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:47.275203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:47.284493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1030/2054] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:47.301774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1025/2055] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:47.520963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:47.569686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:47.571327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:47.670482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c45d6-46ff-49ac-bdf5-d8de0cedb55d service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:47.677698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:47.678250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:47.678653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:47.679030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] PATH_INFO: `/v3/projects/8bcd652179b3441592c2da54e9608a10` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:47.680936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcd652179b3441592c2da54e9608a10)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:47.685932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:47.848920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcd652179b3441592c2da54e9608a10', 'request_id': 'req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:47.856443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcd652179b3441592c2da54e9608a10', 'request_id': 'req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:47.967117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcd652179b3441592c2da54e9608a10', 'request_id': 'req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:47.999647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] The token cache is being invalidate because project 8bcd652179b3441592c2da54e9608a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:47.999971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:48.002540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:48.004309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1031/2056] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:47 2022] DELETE /identity/v3/projects/8bcd652179b3441592c2da54e9608a10 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:48.008578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:48.021683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8629da-7052-4625-93a3-9e033146b9fa service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:48.086631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:48.087531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:48.087971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:48.090687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] PATH_INFO: `/v3/users/2a828df0a94d4ff790ceb7089eb5e478` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:48.090687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a828df0a94d4ff790ceb7089eb5e478)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:48.091705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:48.349047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a828df0a94d4ff790ceb7089eb5e478'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:48.350239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a828df0a94d4ff790ceb7089eb5e478'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:48.365932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a828df0a94d4ff790ceb7089eb5e478'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:48.537813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a828df0a94d4ff790ceb7089eb5e478'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:48.539218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a828df0a94d4ff790ceb7089eb5e478'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:48.573253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1026/2057] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:48 2022] DELETE /identity/v3/users/2a828df0a94d4ff790ceb7089eb5e478 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:48.689501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:48.691087 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:48.722348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc930f2-75a2-4a2f-8dad-b140255d3a1c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:48.732406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:48.793092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:48.794032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:48.794435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:48.794791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] PATH_INFO: `/v3/users/25e73ec0455b4c638779a870bdc3ecb4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:48.796284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e73ec0455b4c638779a870bdc3ecb4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:48.799572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:49.012493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:49.056515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e73ec0455b4c638779a870bdc3ecb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:49.058516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e73ec0455b4c638779a870bdc3ecb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:49.085032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:49.087143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:49.104914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e73ec0455b4c638779a870bdc3ecb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:49.188657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e73ec0455b4c638779a870bdc3ecb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:49.316055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01ef51ba-6323-4426-8867-b93e0a66810d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e73ec0455b4c638779a870bdc3ecb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:49.331283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1032/2058] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:48 2022] DELETE /identity/v3/users/25e73ec0455b4c638779a870bdc3ecb4 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:49.333754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:49.334379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:49.334856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:49.335201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8e500-f6a3-4a10-88ac-93a66fe20eae admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:49.447140 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e476b0-34e3-4b95-a54f-c93f86f6bdc8 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c8f949b0ad4b2b8d0ce1f55e9931d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c962842b243c4dbbabc13b197dbd703c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:49.457038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e476b0-34e3-4b95-a54f-c93f86f6bdc8 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:49.457409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e476b0-34e3-4b95-a54f-c93f86f6bdc8 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:49.457990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e476b0-34e3-4b95-a54f-c93f86f6bdc8 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:49.458943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e476b0-34e3-4b95-a54f-c93f86f6bdc8 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:49.459469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e476b0-34e3-4b95-a54f-c93f86f6bdc8 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:49.462874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e476b0-34e3-4b95-a54f-c93f86f6bdc8 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:49.479700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1027/2059] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:23:49.481402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:49.482011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:49.482492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:49.500382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:49.501799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:49.509694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:49.511026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:49.611463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1028/2060] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:49.612747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:49.615241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:49.626702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1033/2061] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:23:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:49.627887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:49.629673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:49.632449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cac6d-0776-4b02-bb4e-de9887b91817 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:49.637866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:49.638608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:49.638895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:49.639170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] PATH_INFO: `/v3/projects/a8e9eea7fac94264ae9755a217b7282a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:49.640475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e9eea7fac94264ae9755a217b7282a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:49.643260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:49.647485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cae18-16e4-4482-a09c-837e6c067b3f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:49.652094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c8f949b0ad4b2b8d0ce1f55e9931d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c962842b243c4dbbabc13b197dbd703c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:49.652765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:49.653190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:49.653524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:49.654245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:49.656369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:50.071253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1034/2062] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:49 2022] POST /identity/v3/projects => generated 353 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:50.071253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:50.072440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:50.106009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e9eea7fac94264ae9755a217b7282a', 'request_id': 'req-10485493-88af-4f03-91bb-742428f8bf0e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:50.127532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e9eea7fac94264ae9755a217b7282a', 'request_id': 'req-10485493-88af-4f03-91bb-742428f8bf0e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:50.147001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e9eea7fac94264ae9755a217b7282a', 'request_id': 'req-10485493-88af-4f03-91bb-742428f8bf0e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:50.210182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab2093-3206-416a-afad-b7b5d9fc0266 tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:50.326186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] The token cache is being invalidate because project a8e9eea7fac94264ae9755a217b7282a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:50.326893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:50.327584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:50.336434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1029/2063] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:49 2022] DELETE /identity/v3/projects/a8e9eea7fac94264ae9755a217b7282a => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:50.337397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:50.341067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:50.347702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:50.347702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.348050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.348535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.350970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:50.448767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:50.454791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:50.468293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1035/2064] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:50.470042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:50.471502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:50.556217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10485493-88af-4f03-91bb-742428f8bf0e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:50.559275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:50.566000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3c88d-d164-4784-aacb-1694fe57b9df tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c8f949b0ad4b2b8d0ce1f55e9931d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c962842b243c4dbbabc13b197dbd703c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:50.570726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c88d-d164-4784-aacb-1694fe57b9df tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.570726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c88d-d164-4784-aacb-1694fe57b9df tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.570726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c88d-d164-4784-aacb-1694fe57b9df tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.570726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3c88d-d164-4784-aacb-1694fe57b9df tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:50.570726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3c88d-d164-4784-aacb-1694fe57b9df tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:50.572807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3c88d-d164-4784-aacb-1694fe57b9df tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:50.596629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1030/2065] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:50.596629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd28a-4f43-4a94-8aa4-bb691747955d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.596629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd28a-4f43-4a94-8aa4-bb691747955d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.596629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd28a-4f43-4a94-8aa4-bb691747955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.643414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e68fd28a-4f43-4a94-8aa4-bb691747955d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:50.645411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e68fd28a-4f43-4a94-8aa4-bb691747955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:50.659347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1031/2066] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:50.662302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695beced-9e56-4c85-8d96-d52649c2ca45 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:50.667661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2522ec-5038-431b-a34d-5a40810ca702 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.667949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2522ec-5038-431b-a34d-5a40810ca702 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.668233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2522ec-5038-431b-a34d-5a40810ca702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.672730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:50.674206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.675157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.675639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.678145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:50.717868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-df2522ec-5038-431b-a34d-5a40810ca702 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:50.720233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-df2522ec-5038-431b-a34d-5a40810ca702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:50.739709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1032/2067] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:50.739709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2522ec-5038-431b-a34d-5a40810ca702 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:50.761219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2522ec-5038-431b-a34d-5a40810ca702 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:50.776924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:50.777875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c8f949b0ad4b2b8d0ce1f55e9931d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c962842b243c4dbbabc13b197dbd703c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:50.778814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.779386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.779386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] PATH_INFO: `/v3/projects/96843165eb3d4707a3901ca92f396844` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.780698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96843165eb3d4707a3901ca92f396844)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:50.783357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:50.783742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:50.809328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1036/2068] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:23:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:23:50.812403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:50.839043 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87fe02-97d0-4f1d-88d2-5d9b7401de03 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:50.860224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:50.860980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.865937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.865937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.865937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:50.865937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:50.865937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:50.889552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1037/2069] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:50.894341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:50.912866 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e29a4-58c9-43e4-9842-d60d254362cb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:50.919403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:50.919799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:50.920196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:50.920526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:50.921209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:50.924344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:50.980133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96843165eb3d4707a3901ca92f396844', 'request_id': 'req-99c52a2b-3109-425f-ba98-8164cdce587c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.007260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96843165eb3d4707a3901ca92f396844', 'request_id': 'req-99c52a2b-3109-425f-ba98-8164cdce587c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.022278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96843165eb3d4707a3901ca92f396844', 'request_id': 'req-99c52a2b-3109-425f-ba98-8164cdce587c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.030235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1038/2070] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:50 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:51.035333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:51.113021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] The token cache is being invalidate because project 96843165eb3d4707a3901ca92f396844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:51.113645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.115430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.117886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1033/2071] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:50 2022] DELETE /identity/v3/projects/96843165eb3d4707a3901ca92f396844 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:51.148272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8036b0f-1f61-49a0-8a22-de72958242af admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:51.161521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:51.162344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:51.162669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:51.162935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:51.163624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:51.165649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:51.372448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1039/2072] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:51 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:51.378830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:51.382600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:51.394558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:51.400727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:51.440436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8e7d-d3c1-4b70-944f-df3486314246 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:51.446434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:51.446434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:51.446655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:51.447277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] PATH_INFO: `/v3/users/bc0247a0b7c64fa8800397a47b823931` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:51.448502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0247a0b7c64fa8800397a47b823931)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:51.450552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:51.517285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c52a2b-3109-425f-ba98-8164cdce587c tempest-VolumeQuotaClassesTest-177941509 tempest-VolumeQuotaClassesTest-177941509-project-admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:51.522106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:51.522760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:51.523047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:51.523324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:51.524025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:51.525686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:51.549805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1034/2073] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:51.549805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:51.552507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:51.567895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:51.572694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8882d-7be3-443b-814b-0fe43cdd374a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:51.582704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:51.583479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:51.584004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:51.584364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] PATH_INFO: `/v3/projects/386af82666c040e38482d29cf5027ad5` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:51.585844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386af82666c040e38482d29cf5027ad5)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:51.588164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:51.694650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0247a0b7c64fa8800397a47b823931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.695340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0247a0b7c64fa8800397a47b823931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.698045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386af82666c040e38482d29cf5027ad5', 'request_id': 'req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.705668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386af82666c040e38482d29cf5027ad5', 'request_id': 'req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.712866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386af82666c040e38482d29cf5027ad5', 'request_id': 'req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.717940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0247a0b7c64fa8800397a47b823931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.727663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0247a0b7c64fa8800397a47b823931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.813846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] The token cache is being invalidate because project 386af82666c040e38482d29cf5027ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:51.815543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.815543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.816282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1035/2074] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:51 2022] DELETE /identity/v3/projects/386af82666c040e38482d29cf5027ad5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:51.820613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:51.821982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:51.877618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:51.890595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6f3d3-e7c9-40c5-8416-c979b9aa5903 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:51.895698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af433d-45ad-49ac-9e05-ca961549e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:51.896319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af433d-45ad-49ac-9e05-ca961549e362 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:51.896626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af433d-45ad-49ac-9e05-ca961549e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:51.896902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af433d-45ad-49ac-9e05-ca961549e362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:51.897594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af433d-45ad-49ac-9e05-ca961549e362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:51.899215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af433d-45ad-49ac-9e05-ca961549e362 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:51.903375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0247a0b7c64fa8800397a47b823931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:51.916153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1036/2075] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:51.918766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:51.918907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1040/2076] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:51 2022] DELETE /identity/v3/users/bc0247a0b7c64fa8800397a47b823931 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:51.919003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:51.919003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:51.924744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:51.927806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:51.950297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:51.951924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.045766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1037/2077] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:52.046792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:52.048276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.056167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb917ac-225c-4031-81bb-d5aef7479ac3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:52.064548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d37c7-5675-4932-9c18-fba091d799de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:52.065578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d37c7-5675-4932-9c18-fba091d799de admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.066099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d37c7-5675-4932-9c18-fba091d799de admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.066564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d37c7-5675-4932-9c18-fba091d799de admin admin] PATH_INFO: `/v3/projects/9854420dcb734c288da6bb1add68868d/users/2c59cf373e8b4f99904e6983e6986597/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.077032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee972a3-58a6-4447-9390-caa986c394a6 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:52.092325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:52.092325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.094826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.095854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] PATH_INFO: `/v3/users/1c0704079b5e46b4a33c7569982ae322` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.097745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d37c7-5675-4932-9c18-fba091d799de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9854420dcb734c288da6bb1add68868d, user_id=2c59cf373e8b4f99904e6983e6986597, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:52.098054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0704079b5e46b4a33c7569982ae322)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:52.100525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d37c7-5675-4932-9c18-fba091d799de admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:52.101445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:52.192186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1041/2078] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:51 2022] PUT /identity/v3/projects/9854420dcb734c288da6bb1add68868d/users/2c59cf373e8b4f99904e6983e6986597/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:52.196111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291290c-abdf-4bdb-ba86-67bedc9e1b4b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.197069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291290c-abdf-4bdb-ba86-67bedc9e1b4b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.197429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291290c-abdf-4bdb-ba86-67bedc9e1b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.237781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8291290c-abdf-4bdb-ba86-67bedc9e1b4b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:52.238915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8291290c-abdf-4bdb-ba86-67bedc9e1b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.279762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0704079b5e46b4a33c7569982ae322'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.280444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0704079b5e46b4a33c7569982ae322'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.300601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0704079b5e46b4a33c7569982ae322'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.318366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1042/2079] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:52.321699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.321699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.321699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.355841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] MFA Rules not processed for user `2c59cf373e8b4f99904e6983e6986597`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:52.357126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.371428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0704079b5e46b4a33c7569982ae322'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.372077 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0704079b5e46b4a33c7569982ae322'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.386714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1038/2080] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:52 2022] DELETE /identity/v3/users/1c0704079b5e46b4a33c7569982ae322 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:52.387985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:52.390133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.426424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1043/2081] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:52.426650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:52.428079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.444533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ccb5f-f03b-470e-bdc9-c6a085333e71 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:52.456343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e3a04-0421-4d16-bdd4-b11f814b6443 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:52.461154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:52.462193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.462193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.462443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] PATH_INFO: `/v3/projects/6b247d756a8f4abe8d585802df6c862a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.463615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b247d756a8f4abe8d585802df6c862a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:52.465518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:52.503979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:52.504631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.504918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.505200 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] PATH_INFO: `/v3/users/1fa2115e0b1846b2ab1efc8fb3eb04cb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.506428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa2115e0b1846b2ab1efc8fb3eb04cb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:52.508434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:52.569013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b247d756a8f4abe8d585802df6c862a', 'request_id': 'req-f8386cb6-1083-49b7-a497-41c71ec70195'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.575856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b247d756a8f4abe8d585802df6c862a', 'request_id': 'req-f8386cb6-1083-49b7-a497-41c71ec70195'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.582293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b247d756a8f4abe8d585802df6c862a', 'request_id': 'req-f8386cb6-1083-49b7-a497-41c71ec70195'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.663402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] The token cache is being invalidate because project 6b247d756a8f4abe8d585802df6c862a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:52.663694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.664345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.665918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1039/2082] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:52 2022] DELETE /identity/v3/projects/6b247d756a8f4abe8d585802df6c862a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:52.666680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:52.667996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.723213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa2115e0b1846b2ab1efc8fb3eb04cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.723795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa2115e0b1846b2ab1efc8fb3eb04cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.736199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386cb6-1083-49b7-a497-41c71ec70195 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:52.742749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7582cb-b6f8-42ff-9a85-cd346b39d30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:52.742749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7582cb-b6f8-42ff-9a85-cd346b39d30a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.742749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7582cb-b6f8-42ff-9a85-cd346b39d30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.742749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7582cb-b6f8-42ff-9a85-cd346b39d30a admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.743139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7582cb-b6f8-42ff-9a85-cd346b39d30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:52.743419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7582cb-b6f8-42ff-9a85-cd346b39d30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:52.745340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7582cb-b6f8-42ff-9a85-cd346b39d30a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:52.752065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa2115e0b1846b2ab1efc8fb3eb04cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.762287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1040/2083] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:52.762465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa2115e0b1846b2ab1efc8fb3eb04cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.762573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.762573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.762573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.779820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:52.781125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.789196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1041/2084] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:52.790113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:52.791316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.803879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112b5f-c959-4a8e-9cbf-70d041ddd6bc None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:52.808582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:52.809182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.809467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.809767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.810465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:52.812930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:52.851512 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fca7e296-f0c1-4cf9-9217-eb05215d041e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa2115e0b1846b2ab1efc8fb3eb04cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:52.857927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1044/2085] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:52 2022] DELETE /identity/v3/users/1fa2115e0b1846b2ab1efc8fb3eb04cb => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:52.860856 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:52.861153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:52.861484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:52.882456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:52.883678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.926599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:52.934372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1042/2086] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:52 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:52.934372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:52.934372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.951478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1045/2087] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:52.952325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:52.954256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:52.999838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13996bb-1266-4db5-87ad-21a3e50cb699 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.007969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.008594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.008878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.009152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.010436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.011917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.016299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaf0bc-5071-4a99-8c97-bac9d3e6e7ec None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.075514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062639f1-1d8a-4a99-9583-fa743b110a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.076420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062639f1-1d8a-4a99-9583-fa743b110a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.076864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062639f1-1d8a-4a99-9583-fa743b110a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.077304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062639f1-1d8a-4a99-9583-fa743b110a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.080154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-062639f1-1d8a-4a99-9583-fa743b110a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:53.093359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062639f1-1d8a-4a99-9583-fa743b110a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.102900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062639f1-1d8a-4a99-9583-fa743b110a26 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.108223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1046/2088] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:53.110197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d6859-62c5-4a46-815f-e690256702a5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.110498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d6859-62c5-4a46-815f-e690256702a5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.110765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d6859-62c5-4a46-815f-e690256702a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.124386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1043/2089] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:52 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:53.126798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.128825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:53.131035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:53.132450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d33d6859-62c5-4a46-815f-e690256702a5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:53.133609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d33d6859-62c5-4a46-815f-e690256702a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:53.202437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1047/2090] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:53.204634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e800-baa7-45a1-a0ef-7ed293593713 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.205106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e800-baa7-45a1-a0ef-7ed293593713 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.205514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071e800-baa7-45a1-a0ef-7ed293593713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.205750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b208c0-fa11-4be8-a470-be0b5e1a96ca admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.218102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.220104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.220463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.220813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.221569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.223883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.231378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4071e800-baa7-45a1-a0ef-7ed293593713 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:53.236608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4071e800-baa7-45a1-a0ef-7ed293593713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:53.242887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1048/2091] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:53.243687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071e800-baa7-45a1-a0ef-7ed293593713 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.253652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071e800-baa7-45a1-a0ef-7ed293593713 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.258931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.259699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.260073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.260461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.261360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.263450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.328997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1044/2092] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:53 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:53.329863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.331546 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:53.355695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1049/2093] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:53 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:53.356885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.372408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e921b7-0ef4-42df-a19f-685575952494 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.384423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.385122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.386246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.386246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.386967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:53.389256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.393651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.425869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1050/2094] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:53.428881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.453560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454d8bf-23ff-4ff2-b56d-46a6775bde6b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.463903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.463903 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.464128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ada21-93bf-452f-b76f-7fc4fb4c0da3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.464218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.464218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.464746 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.466525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.468034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.469316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.469817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.470638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.481838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1051/2095] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:53.481838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.485676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.487765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.491402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd716d8b-5edb-49f2-9b3a-adea9623b46e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.499545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.501051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.501323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.501604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.502362 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.503762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1045/2096] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:53.504536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.504666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.514354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c8d07-23a1-4b0b-a075-0e8bc11efe87 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.519943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.523623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.523813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1052/2097] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:53.523920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.523920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.524105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.524193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.524193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.533664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992be05-6d4b-462a-ac83-cfa41ac9173e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.542519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.543300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.543587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.543898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] PATH_INFO: `/v3/projects/1c2f6d9f0e7f46d9bb0f07012f2596f0/users/07b41f0a2658410d848d6c7dda42583e/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.560804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2f6d9f0e7f46d9bb0f07012f2596f0, user_id=07b41f0a2658410d848d6c7dda42583e, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.564397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.671011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1046/2098] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:53 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:53.672385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1053/2099] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:53 2022] PUT /identity/v3/projects/1c2f6d9f0e7f46d9bb0f07012f2596f0/users/07b41f0a2658410d848d6c7dda42583e/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:53.673297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.675885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.760783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87122-139b-4553-8b05-f1febf2f7f08 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.761273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a61598-b3e2-4a29-bbbb-0d88b52116f6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.766203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.766755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.767148 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.767372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.767515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.767662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.767807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.767918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.768542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.768650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.770189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.770320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.780697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1047/2100] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:53.782872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1054/2101] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:53.782983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.783078 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.786620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:53.795089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268aa0b-37cb-4c47-af46-8b9f66a03657 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.800203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfdf37-2d5e-4ae7-8fdb-d59dda78e18a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.800568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.801392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.801536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.801810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.802480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.804457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.806889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.807434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.807750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.808031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] PATH_INFO: `/v3/projects/7b1dff693064432d94bddb52a45dd3f3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.809269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1dff693064432d94bddb52a45dd3f3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:53.811265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:53.912830 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1048/2102] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:53 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:53.916158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:53.928161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5829f-966e-4872-abfd-0f38bae4e788 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:53.955583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1dff693064432d94bddb52a45dd3f3', 'request_id': 'req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:53.967187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1dff693064432d94bddb52a45dd3f3', 'request_id': 'req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:53.995955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:53.996628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:53.996907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:53.997183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] PATH_INFO: `/v3/projects/1c2f6d9f0e7f46d9bb0f07012f2596f0/users/07b41f0a2658410d848d6c7dda42583e/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:53.999157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2f6d9f0e7f46d9bb0f07012f2596f0, user_id=07b41f0a2658410d848d6c7dda42583e, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.002733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.013012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1049/2103] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:53 2022] PUT /identity/v3/projects/1c2f6d9f0e7f46d9bb0f07012f2596f0/users/07b41f0a2658410d848d6c7dda42583e/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:54.013739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.045981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1dff693064432d94bddb52a45dd3f3', 'request_id': 'req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.059482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] The token cache is being invalidate because project 7b1dff693064432d94bddb52a45dd3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:54.059779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.060446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.062091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1055/2104] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:53 2022] DELETE /identity/v3/projects/7b1dff693064432d94bddb52a45dd3f3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:54.065780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.067158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.079587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0b6b4-6e95-4716-9cec-97a46d5971a5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.081558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b49a76-380d-4db2-a020-2ec3f21b7ece admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.084643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf733c3-7c9d-4c59-b1b3-d605ee4ea31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.085260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf733c3-7c9d-4c59-b1b3-d605ee4ea31d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.085541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf733c3-7c9d-4c59-b1b3-d605ee4ea31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.085853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf733c3-7c9d-4c59-b1b3-d605ee4ea31d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.086267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.086546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf733c3-7c9d-4c59-b1b3-d605ee4ea31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.086924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.087203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.087475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] PATH_INFO: `/v3/projects/9a9d03603ec04afcab4db71845f7100a/users/a19a9cb2a69d47cfac6d92b6a9bc2367/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.088150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf733c3-7c9d-4c59-b1b3-d605ee4ea31d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.099132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1056/2105] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:54.100655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6e8fe-7665-4918-9c19-6569ccefa921 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.103499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6e8fe-7665-4918-9c19-6569ccefa921 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.103499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6e8fe-7665-4918-9c19-6569ccefa921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.105890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9d03603ec04afcab4db71845f7100a, user_id=a19a9cb2a69d47cfac6d92b6a9bc2367, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.108535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.129167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-62a6e8fe-7665-4918-9c19-6569ccefa921 None None] MFA Rules not processed for user `07b41f0a2658410d848d6c7dda42583e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:54.130706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-62a6e8fe-7665-4918-9c19-6569ccefa921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.188385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1050/2106] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:54 2022] PUT /identity/v3/projects/9a9d03603ec04afcab4db71845f7100a/users/a19a9cb2a69d47cfac6d92b6a9bc2367/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:54.190473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.192371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.226377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1057/2107] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:54.227507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6e8fe-7665-4918-9c19-6569ccefa921 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.240350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6e8fe-7665-4918-9c19-6569ccefa921 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.265181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d212f-665e-4bb4-893d-a7a10d27f263 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.270654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.271339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.271670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.271947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] PATH_INFO: `/v3/users/a248f0e7a2394415b38a0d5642030494` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.273159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a248f0e7a2394415b38a0d5642030494)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.275255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.299212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.299982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.300250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.300526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.301333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.304034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.314911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1058/2108] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:54.315783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.317471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.330158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed187-7886-47fb-9595-51b465224a42 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.334813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.338061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.338061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.338061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] PATH_INFO: `/v3/projects/df5f4c2e3fc44140b4ab62eedbc9017b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.338061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5f4c2e3fc44140b4ab62eedbc9017b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.339221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.429014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:54.568129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a248f0e7a2394415b38a0d5642030494'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.569194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a248f0e7a2394415b38a0d5642030494'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.570539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5f4c2e3fc44140b4ab62eedbc9017b', 'request_id': 'req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.576283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5f4c2e3fc44140b4ab62eedbc9017b', 'request_id': 'req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.585874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a248f0e7a2394415b38a0d5642030494'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.617387 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5f4c2e3fc44140b4ab62eedbc9017b', 'request_id': 'req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.630302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] The token cache is being invalidate because project df5f4c2e3fc44140b4ab62eedbc9017b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:54.630717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.631371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd07e9bf-088e-4888-a0c5-fa2ee5706cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.636021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1059/2109] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:54 2022] DELETE /identity/v3/projects/df5f4c2e3fc44140b4ab62eedbc9017b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:54.636021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.636021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.636021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.641511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:54.664159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a248f0e7a2394415b38a0d5642030494'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.665245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a248f0e7a2394415b38a0d5642030494'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:54.671721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] MFA Rules not processed for user `a19a9cb2a69d47cfac6d92b6a9bc2367`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:54.673166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.700972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1051/2110] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:54 2022] DELETE /identity/v3/users/a248f0e7a2394415b38a0d5642030494 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:54.702024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.704619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.762686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1060/2111] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:54.763604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.765156 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.785138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4804be-9f98-4f90-a774-955ef76cda8f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.790980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.791628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.791904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.792182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.794065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.839611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30524-172d-471b-9b30-c85901d737a3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.862207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.863969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.874411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1052/2112] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:54.876161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:54.877752 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:54.916094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.917877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.917877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.917877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] PATH_INFO: `/v3/projects/9a520b8535d04e39991d68bc1fed1b21/users/d97daca6a6114ddb8149e260dba20189/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.952802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a520b8535d04e39991d68bc1fed1b21, user_id=d97daca6a6114ddb8149e260dba20189, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.960334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:54.982329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28e722-0a97-4cb6-b635-257af1a14334 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:54.989291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:54.989982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:54.990266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:54.990544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] PATH_INFO: `/v3/users/42c8f949b0ad4b2b8d0ce1f55e9931d6` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:54.991755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c8f949b0ad4b2b8d0ce1f55e9931d6)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:54.998281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:55.052606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1061/2113] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:54 2022] PUT /identity/v3/projects/9a520b8535d04e39991d68bc1fed1b21/users/d97daca6a6114ddb8149e260dba20189/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:55.053535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:55.055441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.137385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43954abe-bb7b-4578-8c6e-44c23984f88b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:55.142832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:55.146310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:55.146577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:55.146858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] PATH_INFO: `/v3/users/4fb3a69597164ab1969f734bee0f7167` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:55.150521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb3a69597164ab1969f734bee0f7167)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:55.152563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:55.226578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c8f949b0ad4b2b8d0ce1f55e9931d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.227249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c8f949b0ad4b2b8d0ce1f55e9931d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.239549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c8f949b0ad4b2b8d0ce1f55e9931d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.332012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c8f949b0ad4b2b8d0ce1f55e9931d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.332733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c8f949b0ad4b2b8d0ce1f55e9931d6'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.347750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1053/2114] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:54 2022] DELETE /identity/v3/users/42c8f949b0ad4b2b8d0ce1f55e9931d6 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:55.348590 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:55.349968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.380220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb3a69597164ab1969f734bee0f7167'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.381515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb3a69597164ab1969f734bee0f7167'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.398366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb3a69597164ab1969f734bee0f7167'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.406242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb3a69597164ab1969f734bee0f7167'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.417062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706fd4a-1825-47b4-a022-46c2712f4053 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:55.420927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:55.421591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:55.421918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:55.422193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:55.424368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.474440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e5879f7-4051-4e55-9a83-c500de42212b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb3a69597164ab1969f734bee0f7167'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.480996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1062/2115] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:23:55 2022] DELETE /identity/v3/users/4fb3a69597164ab1969f734bee0f7167 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:55.482269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e80b3-5c2e-4d5e-9e5f-8df3020f8da7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:55.482556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e80b3-5c2e-4d5e-9e5f-8df3020f8da7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:55.482841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e80b3-5c2e-4d5e-9e5f-8df3020f8da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:55.487569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:55.489110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:55.498785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1054/2116] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:55.503794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:55.503794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.525615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-373e80b3-5c2e-4d5e-9e5f-8df3020f8da7 None None] MFA Rules not processed for user `d97daca6a6114ddb8149e260dba20189`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:55.527164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-373e80b3-5c2e-4d5e-9e5f-8df3020f8da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.572560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:55.613360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fa4eb-73fc-4014-a044-c05c65d26979 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:55.723603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:55.724383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:55.724679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:55.724960 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] PATH_INFO: `/v3/projects/d5d68573ac2f49e2bd7a158e502c2126` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:55.726194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d68573ac2f49e2bd7a158e502c2126)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:55.728762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:55.729618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1063/2117] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:55.733314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:55.733615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:55.733923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:55.745247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:55.778327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:55.779913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.798196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1064/2118] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:55.799524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:55.801647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.816052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe179-59f3-41e4-8b53-b11838b0e3c5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:55.820955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:55.821594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:55.822183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:55.824837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:55.825527 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:55.827503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:55.851519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d68573ac2f49e2bd7a158e502c2126', 'request_id': 'req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.857989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d68573ac2f49e2bd7a158e502c2126', 'request_id': 'req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.864947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d68573ac2f49e2bd7a158e502c2126', 'request_id': 'req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.958469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1065/2119] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:55 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:55.958469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:55.959162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:55.986783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] The token cache is being invalidate because project d5d68573ac2f49e2bd7a158e502c2126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:55.987149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.990138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:55.993739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1055/2120] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:55 2022] DELETE /identity/v3/projects/d5d68573ac2f49e2bd7a158e502c2126 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:55.995734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:55.998509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.034150 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be158a-9020-468f-b9bd-b719a66c723b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.038210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.039711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.039711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.039711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.041453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.076231 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2da93f-0f88-4b2f-b660-4e7b5c3dd83f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.110896 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.112388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.123375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1066/2121] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:56.124250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.126331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.141367 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da485499-2f6f-4a69-bf51-0bdc9292dba9 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.146444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dc524-bace-4809-85d0-40166e2e68b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.147141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc524-bace-4809-85d0-40166e2e68b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.147530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc524-bace-4809-85d0-40166e2e68b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.147873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc524-bace-4809-85d0-40166e2e68b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.148614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dc524-bace-4809-85d0-40166e2e68b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.150687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dc524-bace-4809-85d0-40166e2e68b1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.166694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.169323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.169323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.169323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] PATH_INFO: `/v3/projects/c962842b243c4dbbabc13b197dbd703c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.169323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c962842b243c4dbbabc13b197dbd703c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.171198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.292410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1067/2122] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:56 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:56.293696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a03d7-b303-48b6-9087-265a4538df68 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.294024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a03d7-b303-48b6-9087-265a4538df68 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.294309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a03d7-b303-48b6-9087-265a4538df68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.315421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ad2a03d7-b303-48b6-9087-265a4538df68 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:56.318276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ad2a03d7-b303-48b6-9087-265a4538df68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.325536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1068/2123] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:56.326337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a03d7-b303-48b6-9087-265a4538df68 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.336494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a03d7-b303-48b6-9087-265a4538df68 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.341129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47112b9-4d2b-497c-87e1-f3f9af167625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.341768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47112b9-4d2b-497c-87e1-f3f9af167625 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.342056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47112b9-4d2b-497c-87e1-f3f9af167625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.342334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47112b9-4d2b-497c-87e1-f3f9af167625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.343020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47112b9-4d2b-497c-87e1-f3f9af167625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.344735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47112b9-4d2b-497c-87e1-f3f9af167625 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.355082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1069/2124] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:56.356241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57b49-3e60-40ed-941e-b683f4edc3c1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.356536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57b49-3e60-40ed-941e-b683f4edc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.356823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57b49-3e60-40ed-941e-b683f4edc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.375597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c962842b243c4dbbabc13b197dbd703c', 'request_id': 'req-ea572888-7afe-459f-bed2-df2bf855e9ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:56.383204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c962842b243c4dbbabc13b197dbd703c', 'request_id': 'req-ea572888-7afe-459f-bed2-df2bf855e9ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:56.388708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f8a57b49-3e60-40ed-941e-b683f4edc3c1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:56.393853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c962842b243c4dbbabc13b197dbd703c', 'request_id': 'req-ea572888-7afe-459f-bed2-df2bf855e9ae'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:56.394002 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f8a57b49-3e60-40ed-941e-b683f4edc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.488047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1070/2125] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:56.489252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57b49-3e60-40ed-941e-b683f4edc3c1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.493130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] The token cache is being invalidate because project c962842b243c4dbbabc13b197dbd703c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:56.493494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:56.494727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:56.497605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1056/2126] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:55 2022] DELETE /identity/v3/projects/c962842b243c4dbbabc13b197dbd703c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:56.499036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.501349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.507855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57b49-3e60-40ed-941e-b683f4edc3c1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.513427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861d27-d1ba-45c7-82ce-cc34fbfd92a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.514270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861d27-d1ba-45c7-82ce-cc34fbfd92a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.514424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861d27-d1ba-45c7-82ce-cc34fbfd92a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.514712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861d27-d1ba-45c7-82ce-cc34fbfd92a2 admin admin] PATH_INFO: `/v3/projects/023b964bcaa34f0d96f617ab20dbfcda/users/972b8c98e5ce48978155e569213fe70e/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.520752 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572888-7afe-459f-bed2-df2bf855e9ae admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.527600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708515a3-b772-45ce-a723-c270ba1ca05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.528816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708515a3-b772-45ce-a723-c270ba1ca05d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.529903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708515a3-b772-45ce-a723-c270ba1ca05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.530283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708515a3-b772-45ce-a723-c270ba1ca05d admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.531249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708515a3-b772-45ce-a723-c270ba1ca05d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:56.531871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708515a3-b772-45ce-a723-c270ba1ca05d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.533766 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708515a3-b772-45ce-a723-c270ba1ca05d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.540649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce861d27-d1ba-45c7-82ce-cc34fbfd92a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023b964bcaa34f0d96f617ab20dbfcda, user_id=972b8c98e5ce48978155e569213fe70e, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.546079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce861d27-d1ba-45c7-82ce-cc34fbfd92a2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.549889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1057/2127] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:56.551464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4d68c-10b4-4c25-a9dd-0ac58d82ac45 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.551952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4d68c-10b4-4c25-a9dd-0ac58d82ac45 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.552393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4d68c-10b4-4c25-a9dd-0ac58d82ac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.584035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c0b4d68c-10b4-4c25-a9dd-0ac58d82ac45 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:56.586110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c0b4d68c-10b4-4c25-a9dd-0ac58d82ac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.595146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1058/2128] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:56.596075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4d68c-10b4-4c25-a9dd-0ac58d82ac45 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.606492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1071/2129] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:56 2022] PUT /identity/v3/projects/023b964bcaa34f0d96f617ab20dbfcda/users/972b8c98e5ce48978155e569213fe70e/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:56.606707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4d68c-10b4-4c25-a9dd-0ac58d82ac45 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.607797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.608090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.609019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.628490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:56.632632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.670031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.670660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.670942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.671215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.672425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.674568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.696654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1072/2130] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:56.697555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.698994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.711422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51878-5e01-4838-abf9-69552b8f975b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.716197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.716806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.717088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.717396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.718095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.720110 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.741392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1073/2131] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:56.744471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.756576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505225e-e3b7-4ed6-8661-9876b6dafaee admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.762399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.763031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.763429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.763620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.764447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:56.764809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.767116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.784539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1059/2132] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:56 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:56.784539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.792279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1074/2133] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:56.792279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.798807 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:56.813196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a87d56-fbe7-4bba-b15a-749f4bf8a17c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.853391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980efbc-2a1b-4241-bb34-22c9df155952 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.858293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.858843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.859875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.860167 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] PATH_INFO: `/v3/projects/023b964bcaa34f0d96f617ab20dbfcda/users/972b8c98e5ce48978155e569213fe70e/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.864750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=023b964bcaa34f0d96f617ab20dbfcda, user_id=972b8c98e5ce48978155e569213fe70e, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.867525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.886996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1060/2134] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:56 2022] PUT /identity/v3/projects/023b964bcaa34f0d96f617ab20dbfcda/users/972b8c98e5ce48978155e569213fe70e/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:56.887985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:56.897561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.899581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.899581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.899581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] PATH_INFO: `/v3/projects/0ec26e0ee1084cce84c20105cdcfe785` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.900948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec26e0ee1084cce84c20105cdcfe785)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.903004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.961555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365736f8-919a-41aa-a42c-1c8e2614e29d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:56.966281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:56.968993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:56.968993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:56.968993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:56.968993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:56.970872 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:56.989568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:57.029789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec26e0ee1084cce84c20105cdcfe785', 'request_id': 'req-7c76f79a-2364-499d-b7b7-876291c533fb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:57.036424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec26e0ee1084cce84c20105cdcfe785', 'request_id': 'req-7c76f79a-2364-499d-b7b7-876291c533fb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:57.044184 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1061/2135] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:56 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:57.045242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.060316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67c737-2074-4e40-9de2-caf1eeea05c8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.111562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.112171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.112453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.112729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.113386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.115336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.142794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec26e0ee1084cce84c20105cdcfe785', 'request_id': 'req-7c76f79a-2364-499d-b7b7-876291c533fb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:57.154729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] The token cache is being invalidate because project 0ec26e0ee1084cce84c20105cdcfe785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:23:57.155016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:57.155684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7c76f79a-2364-499d-b7b7-876291c533fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:23:57.158318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1075/2136] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:23:56 2022] DELETE /identity/v3/projects/0ec26e0ee1084cce84c20105cdcfe785 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:57.159556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d178-7d5f-4142-ad2b-c3ecc7ed4b27 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.159836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d178-7d5f-4142-ad2b-c3ecc7ed4b27 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.160111 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d178-7d5f-4142-ad2b-c3ecc7ed4b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.187596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4d23d178-7d5f-4142-ad2b-c3ecc7ed4b27 None None] MFA Rules not processed for user `972b8c98e5ce48978155e569213fe70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:57.189000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4d23d178-7d5f-4142-ad2b-c3ecc7ed4b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.194057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1062/2137] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/projects => generated 399 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:57.194057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.194057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.233251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:57.272137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d32b47-b8d3-45a6-bbca-17df440f191b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.277953 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.278860 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.279446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.279446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.285653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.285653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.286314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1076/2138] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:57.291049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.291549 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.291834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.299091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1063/2139] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:57.299091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.300776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.314117 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:57.314300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943b6c-fe04-471e-a6ea-95a416ade664 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.315136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.319132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9dea4-331c-4bb7-ad35-db3599793b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.319790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9dea4-331c-4bb7-ad35-db3599793b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.320093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9dea4-331c-4bb7-ad35-db3599793b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.320392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9dea4-331c-4bb7-ad35-db3599793b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.321062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9dea4-331c-4bb7-ad35-db3599793b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.323016 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1077/2140] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:57.323125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9dea4-331c-4bb7-ad35-db3599793b07 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.323773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.324985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.390258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ba63f-35fb-464d-8ed2-19cd4315152a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.394139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.394787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.395070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.395348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.404540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.406230 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.415722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1078/2141] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:57.416678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.427702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75652d3-3e74-4d85-9c41-d65d7dd50579 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.433632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.434414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.434770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.435119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.439175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1064/2142] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:57.441000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.441107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6513-7aa3-4c63-96a3-beead91ad94b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.441107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6513-7aa3-4c63-96a3-beead91ad94b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.441107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6513-7aa3-4c63-96a3-beead91ad94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.441365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.450135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1079/2143] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:57.450961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.459236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-3d7d6513-7aa3-4c63-96a3-beead91ad94b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:57.460557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3d7d6513-7aa3-4c63-96a3-beead91ad94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.461342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2a868-31c9-45f3-9076-1cfd2fa3820d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.468572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.469886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.470130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.470494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.471086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.471505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1065/2144] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:57.472388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6513-7aa3-4c63-96a3-beead91ad94b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.472687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.483772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6513-7aa3-4c63-96a3-beead91ad94b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.498236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1080/2145] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:57.498236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.502826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.503931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.504443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.504922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] PATH_INFO: `/v3/projects/86ab181f8974478486a2ebb37935b0c1/users/8c8e4ea8e506442aa086d82a70a36c8a/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.510350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ac468-9df1-48d6-ace2-5cbfd35703b3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.524879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.524879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.524879 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.525158 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ab181f8974478486a2ebb37935b0c1, user_id=8c8e4ea8e506442aa086d82a70a36c8a, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.525250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.525250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:23:57.525250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.526590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.526848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.553921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1081/2146] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:23:57.553921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.559261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a9a8b-7b5c-48c4-8206-ee23a6c13ee5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.566272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.566922 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.567293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.567664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.568525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.570595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.584625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1082/2147] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:57.584625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.597145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b27cd2-5299-4e88-a6f2-d16640b17c57 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.601977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a341f5b-06de-4846-828a-2c195527cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.602876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341f5b-06de-4846-828a-2c195527cae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.603331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341f5b-06de-4846-828a-2c195527cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.603789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341f5b-06de-4846-828a-2c195527cae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.604539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a341f5b-06de-4846-828a-2c195527cae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.606714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a341f5b-06de-4846-828a-2c195527cae8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.637610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1066/2148] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:57 2022] PUT /identity/v3/projects/86ab181f8974478486a2ebb37935b0c1/users/8c8e4ea8e506442aa086d82a70a36c8a/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:57.638625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.713068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ef8e-7e6a-4d2c-80be-63753e42ce20 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.723123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.723806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.724165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.724348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] PATH_INFO: `/v3/projects/32f167d8fb874b568a7cf8af11a7e3ee/users/b881e2fb57cb4819836b8115ac43396e/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.733473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1083/2149] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:57.733473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cb3af-e131-45f0-9ae5-134faf77da83 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.733473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cb3af-e131-45f0-9ae5-134faf77da83 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.733473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cb3af-e131-45f0-9ae5-134faf77da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.740919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f167d8fb874b568a7cf8af11a7e3ee, user_id=b881e2fb57cb4819836b8115ac43396e, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.743672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.764311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cc2cb3af-e131-45f0-9ae5-134faf77da83 None None] MFA Rules not processed for user `8c8e4ea8e506442aa086d82a70a36c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:57.770970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cc2cb3af-e131-45f0-9ae5-134faf77da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.822718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1067/2150] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:57 2022] PUT /identity/v3/projects/32f167d8fb874b568a7cf8af11a7e3ee/users/b881e2fb57cb4819836b8115ac43396e/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:57.824307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.831486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.850760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1084/2151] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:57.851864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cb3af-e131-45f0-9ae5-134faf77da83 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:57.900795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65bd9-f414-4b2e-bad2-447a7e7d6482 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.904537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9cb73-475c-4172-ab00-adfa228b56b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.905155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9cb73-475c-4172-ab00-adfa228b56b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.905437 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9cb73-475c-4172-ab00-adfa228b56b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.905711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9cb73-475c-4172-ab00-adfa228b56b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.907679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-afe9cb73-475c-4172-ab00-adfa228b56b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:57.927208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cb3af-e131-45f0-9ae5-134faf77da83 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:57.981604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9cb73-475c-4172-ab00-adfa228b56b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.983099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9cb73-475c-4172-ab00-adfa228b56b3 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:57.991597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:57.992575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.993011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.993434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.993758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1068/2152] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:57.994697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:57.995430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aabe9b-c5ff-4d86-805b-79a650f9b727 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:57.995721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aabe9b-c5ff-4d86-805b-79a650f9b727 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:57.996005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aabe9b-c5ff-4d86-805b-79a650f9b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:57.997463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.025796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e4aabe9b-c5ff-4d86-805b-79a650f9b727 None None] MFA Rules not processed for user `b881e2fb57cb4819836b8115ac43396e`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:58.027287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e4aabe9b-c5ff-4d86-805b-79a650f9b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:58.092726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1069/2153] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:58.094163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aabe9b-c5ff-4d86-805b-79a650f9b727 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.103196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1085/2154] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:57 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:58.103932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.107777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aabe9b-c5ff-4d86-805b-79a650f9b727 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.113313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.113977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.114261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.114453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bd75d-1b70-4bf1-b0b7-2edaf8192658 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.114557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.115218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.117157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.120022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.126450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.126450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.126450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.126450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.126450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.202531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1070/2155] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:58 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:58.211516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.240033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1086/2156] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:23:58 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:58.240033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.260372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:58.278313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb648b-8848-4bbd-87ac-adb5507dde07 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.306560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3be45-cd24-497e-aa4a-b79852d34f46 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.311572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.312871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.313159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.313442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.314172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.316159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.337303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.337961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.338245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.338522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.339226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.340885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.351577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1071/2157] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:58.352408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.366047 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf79a9-b5c0-4e84-9f05-a2528428b1ec admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.370988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.371603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.371880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.372159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.372820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.375651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.480982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1087/2158] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:58 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:58.482115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.492548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b38d24-95df-4291-9d15-1c911f16d5b0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.498075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.500348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.500348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.500348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.500568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.502505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.503807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1072/2159] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:23:58 2022] POST /identity/v3/users => generated 307 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:23:58.504807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.519898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87259d-1783-4ad1-8adc-5ee14dc5f3a8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.524135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1088/2160] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:58.524135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.527105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.527855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.528241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.528841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.529912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.531957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.544800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4783f-ea2e-4b08-b042-be05fc1a1c22 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.546083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1073/2161] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:58.547750 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.554162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.554795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.555085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.555366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.556071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.557698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.559064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e768-34e9-4d95-80b8-4b7786c09d78 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.565084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.566227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.566751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.568124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:58.568782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] PATH_INFO: `/v3/projects/2a33d16da6604ea1b9cb7858dc315b0a/users/3d825c88d6fe4af18b65455d28653130/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.569628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1089/2162] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:58.570456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.580634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddd8a6-e901-442a-a6ce-187c9eabe22b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.585113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a33d16da6604ea1b9cb7858dc315b0a, user_id=3d825c88d6fe4af18b65455d28653130, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.585433 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5ce8b-29c7-49fb-9599-80b8c2ae19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.586131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ce8b-29c7-49fb-9599-80b8c2ae19b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.586417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ce8b-29c7-49fb-9599-80b8c2ae19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.586697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ce8b-29c7-49fb-9599-80b8c2ae19b7 admin admin] PATH_INFO: `/v3/projects/9eb1efbf3519426b93e1d480c1dabd5a/users/1d58cf8fcf844b1fa1f9635045e2274b/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.587781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.601507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5ce8b-29c7-49fb-9599-80b8c2ae19b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb1efbf3519426b93e1d480c1dabd5a, user_id=1d58cf8fcf844b1fa1f9635045e2274b, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.604323 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5ce8b-29c7-49fb-9599-80b8c2ae19b7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.671121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1074/2163] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:58 2022] PUT /identity/v3/projects/2a33d16da6604ea1b9cb7858dc315b0a/users/3d825c88d6fe4af18b65455d28653130/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:58.672519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.682348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1090/2164] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:58 2022] PUT /identity/v3/projects/9eb1efbf3519426b93e1d480c1dabd5a/users/1d58cf8fcf844b1fa1f9635045e2274b/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:58.684080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300dd9-b871-49b9-8e66-a09b6c9dfeb9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.684080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300dd9-b871-49b9-8e66-a09b6c9dfeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.684291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300dd9-b871-49b9-8e66-a09b6c9dfeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.722236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-96300dd9-b871-49b9-8e66-a09b6c9dfeb9 None None] MFA Rules not processed for user `3d825c88d6fe4af18b65455d28653130`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:58.723785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-96300dd9-b871-49b9-8e66-a09b6c9dfeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:58.760227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358be5f-f0ac-4df2-bfa2-a1c0ef12ad93 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.819032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1091/2165] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:58.820814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96300dd9-b871-49b9-8e66-a09b6c9dfeb9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.854998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.856103 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.856620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.857000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] PATH_INFO: `/v3/projects/2337da90c33a41daafc53eaf1a3b8e02/users/e1df3ba3b55945a9829c93a226d67fa3/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.891059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2337da90c33a41daafc53eaf1a3b8e02, user_id=e1df3ba3b55945a9829c93a226d67fa3, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.894549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.908121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96300dd9-b871-49b9-8e66-a09b6c9dfeb9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:58.913195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:58.913891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:58.914179 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:58.923407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:58.923407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:58.923407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:58.935510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1092/2166] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:58.936540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:58.938580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:58.979233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1075/2167] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:58 2022] PUT /identity/v3/projects/2337da90c33a41daafc53eaf1a3b8e02/users/e1df3ba3b55945a9829c93a226d67fa3/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:58.983513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:59.058403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b4537-7670-4a7f-8940-5b526ad49282 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:59.069816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52591752-0be3-4d1a-b481-0380df15728f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:59.074852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:59.075521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.075800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.076073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] PATH_INFO: `/v3/projects/9eb1efbf3519426b93e1d480c1dabd5a/users/1d58cf8fcf844b1fa1f9635045e2274b/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.079252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb1efbf3519426b93e1d480c1dabd5a, user_id=1d58cf8fcf844b1fa1f9635045e2274b, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:59.081975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:59.110005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1076/2168] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:58 2022] PUT /identity/v3/projects/9eb1efbf3519426b93e1d480c1dabd5a/users/1d58cf8fcf844b1fa1f9635045e2274b/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:59.117962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:59.149895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:59.150580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.150967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.151136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.196823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922155e-cf8d-4a9f-87eb-dcbaac084790 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:59.202416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e0750-f133-499d-a71e-cec0d4921795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:59.203739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e0750-f133-499d-a71e-cec0d4921795 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.204030 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e0750-f133-499d-a71e-cec0d4921795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.204310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e0750-f133-499d-a71e-cec0d4921795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.205060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e0750-f133-499d-a71e-cec0d4921795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:59.206818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e0750-f133-499d-a71e-cec0d4921795 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:59.214825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:59.216543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:59.217442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1077/2169] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:23:59.222586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1fc3-032b-4c83-b104-172a0710b686 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.223424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1fc3-032b-4c83-b104-172a0710b686 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.223424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1fc3-032b-4c83-b104-172a0710b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.227207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1093/2170] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:59.228010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:59.239649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87295865-763f-456b-a7cf-66fc896b19c7 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:59.245312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e97378-6e4f-4ddb-a571-53eb4684ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:59.246022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e97378-6e4f-4ddb-a571-53eb4684ae2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.246303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e97378-6e4f-4ddb-a571-53eb4684ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.246585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e97378-6e4f-4ddb-a571-53eb4684ae2c admin admin] PATH_INFO: `/v3/projects/2337da90c33a41daafc53eaf1a3b8e02/users/e1df3ba3b55945a9829c93a226d67fa3/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.248634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e97378-6e4f-4ddb-a571-53eb4684ae2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2337da90c33a41daafc53eaf1a3b8e02, user_id=e1df3ba3b55945a9829c93a226d67fa3, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:59.251692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e97378-6e4f-4ddb-a571-53eb4684ae2c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:59.261581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a5ea1fc3-032b-4c83-b104-172a0710b686 None None] MFA Rules not processed for user `1d58cf8fcf844b1fa1f9635045e2274b`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:59.265615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1094/2171] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:23:59 2022] PUT /identity/v3/projects/2337da90c33a41daafc53eaf1a3b8e02/users/e1df3ba3b55945a9829c93a226d67fa3/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:23:59.265767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a5ea1fc3-032b-4c83-b104-172a0710b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:59.273199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bfeb-4970-4509-bc36-9fa851e6b59a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.273490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bfeb-4970-4509-bc36-9fa851e6b59a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.273936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bfeb-4970-4509-bc36-9fa851e6b59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.303396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7405bfeb-4970-4509-bc36-9fa851e6b59a None None] MFA Rules not processed for user `e1df3ba3b55945a9829c93a226d67fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:23:59.304709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7405bfeb-4970-4509-bc36-9fa851e6b59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:23:59.333160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1078/2172] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:23:59.388507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1095/2173] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:23:59 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:23:59.562229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea1fc3-032b-4c83-b104-172a0710b686 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:59.616304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea1fc3-032b-4c83-b104-172a0710b686 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:59.620951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:59.621897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.622463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.623039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.635428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:59.636852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:59.644580 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:59.649733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1079/2174] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:59.713269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bfeb-4970-4509-bc36-9fa851e6b59a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:23:59.722948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bfeb-4970-4509-bc36-9fa851e6b59a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:23:59.726735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:23:59.727430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:23:59.727736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:23:59.728012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:23:59.739328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:23:59.741003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:23:59.751687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1096/2175] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:23:59 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:23:59.903783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:00.147836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:00.157330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b346-cb2a-4e3a-9b0d-ddc160e9089d service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:00.161310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:00.161976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:00.162264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:00.162543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:00.231669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:00.233112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:00.242989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1080/2176] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:00.606503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:00.818102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:00.819731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:00.863968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:00.895745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:00.901390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755f5aa-1587-46be-aa4a-a66d376704e6 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:00.906693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442eec7-6797-4331-b4c8-7db1a002aefd service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:00.907823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:00.908672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:00.909042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:00.909400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] PATH_INFO: `/v3/users/a19a9cb2a69d47cfac6d92b6a9bc2367` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:00.910882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19a9cb2a69d47cfac6d92b6a9bc2367)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:00.912734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:00.922228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:00.928557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:00.929124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:00.929419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:01.023479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:01.025171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:01.048172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1081/2177] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:01.165178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19a9cb2a69d47cfac6d92b6a9bc2367'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:01.165874 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19a9cb2a69d47cfac6d92b6a9bc2367'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:01.178021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:01.185419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19a9cb2a69d47cfac6d92b6a9bc2367'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:01.195299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19a9cb2a69d47cfac6d92b6a9bc2367'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:01.261883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:01.271074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a71c-4439-4350-9c7e-d90b8863fd8b service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:01.274718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:01.275328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:01.275640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:01.275920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:01.277654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:01.291445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d19176c7-5707-472a-8b89-f29bc1940ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19a9cb2a69d47cfac6d92b6a9bc2367'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:01.300040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1097/2178] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:00 2022] DELETE /identity/v3/users/a19a9cb2a69d47cfac6d92b6a9bc2367 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:01.305127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:01.305420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:01.305701 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:01.326459 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:01.327748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:01.344115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:01.345562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:01.355367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1082/2179] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:01.389579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1098/2180] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:01.400797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:01.402238 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:01.473218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615bdbc-3d4c-4d3d-841b-64b69f603446 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:01.528301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3e6ce-c986-4d0c-80b3-ccb87afb8e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:01.528844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e6ce-c986-4d0c-80b3-ccb87afb8e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:01.529127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e6ce-c986-4d0c-80b3-ccb87afb8e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:01.529413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e6ce-c986-4d0c-80b3-ccb87afb8e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:01.539966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3e6ce-c986-4d0c-80b3-ccb87afb8e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:01.541403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3e6ce-c986-4d0c-80b3-ccb87afb8e6d service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:01.552351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1083/2181] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:01.938439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:02.014135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:02.016547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:02.029838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5a18f-736a-487a-a3e0-11dd6cb44214 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:02.037531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:02.037531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.037531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.037531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] PATH_INFO: `/v3/projects/9a9d03603ec04afcab4db71845f7100a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.038814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9d03603ec04afcab4db71845f7100a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:02.040845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:02.195317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9d03603ec04afcab4db71845f7100a', 'request_id': 'req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:02.201529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9d03603ec04afcab4db71845f7100a', 'request_id': 'req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:02.246690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:02.338109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9d03603ec04afcab4db71845f7100a', 'request_id': 'req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:02.360972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] The token cache is being invalidate because project 9a9d03603ec04afcab4db71845f7100a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:02.361295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:02.362035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b2ac77ea-fdc9-4f6f-9b19-3d8aea408bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:02.363581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1099/2182] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:02 2022] DELETE /identity/v3/projects/9a9d03603ec04afcab4db71845f7100a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:02.368527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5c65-52f6-409b-b22b-590d1a568d3e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.369290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5c65-52f6-409b-b22b-590d1a568d3e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.369679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5c65-52f6-409b-b22b-590d1a568d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.391619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-247b5c65-52f6-409b-b22b-590d1a568d3e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:02.393381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-247b5c65-52f6-409b-b22b-590d1a568d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:02.458200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1084/2183] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:02.467253 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028c15f-e6df-4faa-8f0f-dd577aab453d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.467538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028c15f-e6df-4faa-8f0f-dd577aab453d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.467815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028c15f-e6df-4faa-8f0f-dd577aab453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.490459 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8028c15f-e6df-4faa-8f0f-dd577aab453d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:02.491707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8028c15f-e6df-4faa-8f0f-dd577aab453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:02.500536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1100/2184] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:02.504999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5c65-52f6-409b-b22b-590d1a568d3e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:02.515065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5c65-52f6-409b-b22b-590d1a568d3e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:02.520333 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:02.520951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.521238 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.521523 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.522260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:02.522569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:02.524295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:02.540561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1085/2185] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:02.541580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028c15f-e6df-4faa-8f0f-dd577aab453d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:02.551675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028c15f-e6df-4faa-8f0f-dd577aab453d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:02.556517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:02.557128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.557410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.557685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.558465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:02.560363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:02.683878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1101/2186] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:02 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:02.690791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:02.701105 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65aff8-0d91-42e4-a77b-becadd764f71 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:02.729069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:02.764604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:02.765525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.765839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.766116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.766795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:02.769274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:02.873170 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1086/2187] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:02 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:02.874406 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:02.885144 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311916de-e376-4dee-a0c1-f65c5cd25821 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:02.892469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:02.892469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.892469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.892469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.892834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:02.893467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:02.903777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1102/2188] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:02.909125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:02.919206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e1643-30e6-4d3d-b403-485f55648678 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:02.924539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42814873-20b7-4a27-af66-573f866e924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:02.928744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42814873-20b7-4a27-af66-573f866e924c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.928744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42814873-20b7-4a27-af66-573f866e924c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.928744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42814873-20b7-4a27-af66-573f866e924c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.928744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42814873-20b7-4a27-af66-573f866e924c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:02.929191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42814873-20b7-4a27-af66-573f866e924c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:02.942233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1087/2189] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:02.946719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:02.957506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446362ef-7fa8-4bb2-946b-e2e580ead317 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:02.962353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:02.963047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:02.963333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:02.963648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] PATH_INFO: `/v3/projects/c89989d20f194e47b291339bde161549/users/df8374b04fd142a8a97503e0a0774960/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:02.980071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89989d20f194e47b291339bde161549, user_id=df8374b04fd142a8a97503e0a0774960, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:02.982833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:03.110566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1103/2190] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:02 2022] PUT /identity/v3/projects/c89989d20f194e47b291339bde161549/users/df8374b04fd142a8a97503e0a0774960/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:03.115780 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:03.116003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:03.116281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:03.135903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:03.137195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:03.209314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1088/2191] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:03.228740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:03.232549 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:03.307361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89778b69-1a33-4057-b096-a16a8b9627c8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:03.311571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d9564-3393-436e-810b-6c5ae409f827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:03.313428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d9564-3393-436e-810b-6c5ae409f827 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:03.313428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d9564-3393-436e-810b-6c5ae409f827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:03.313996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d9564-3393-436e-810b-6c5ae409f827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:03.326098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d9564-3393-436e-810b-6c5ae409f827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:03.327660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d9564-3393-436e-810b-6c5ae409f827 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:03.340599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1104/2192] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:03.808763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:03.811041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:03.825541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5840-1859-479f-a73e-6d3cbf156b96 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:03.834919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:03.843251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:03.843251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:03.843251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] PATH_INFO: `/v3/users/3d825c88d6fe4af18b65455d28653130` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:03.843251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d825c88d6fe4af18b65455d28653130)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:03.843251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:04.140711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d825c88d6fe4af18b65455d28653130'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:04.142221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d825c88d6fe4af18b65455d28653130'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:04.162162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d825c88d6fe4af18b65455d28653130'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:04.229309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d825c88d6fe4af18b65455d28653130'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:04.230018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d825c88d6fe4af18b65455d28653130'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:04.257403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1089/2193] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:03 2022] DELETE /identity/v3/users/3d825c88d6fe4af18b65455d28653130 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:04.263054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a4f1-01c6-4779-9a51-671d94d7af41 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:04.267667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a4f1-01c6-4779-9a51-671d94d7af41 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:04.267667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a4f1-01c6-4779-9a51-671d94d7af41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:04.286594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4cb0a4f1-01c6-4779-9a51-671d94d7af41 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:04.287816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4cb0a4f1-01c6-4779-9a51-671d94d7af41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:04.349511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1105/2194] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:04.362200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:04.364079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:04.442856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4498b8-0ee7-4553-93c7-3462c6424712 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:04.446951 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:04.447651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:04.447941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:04.448225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:04.460230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:04.466847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:04.480532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1090/2195] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:04.852268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:04.955170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:04.955461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:04.955744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:04.972726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:04.975126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:04.997510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f2f3f-838c-462d-b143-849a7ce0b5b6 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:05.007813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] MFA Rules not processed for user `df8374b04fd142a8a97503e0a0774960`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:05.009048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.023132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:05.024349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.025996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.026498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] PATH_INFO: `/v3/users/8c8e4ea8e506442aa086d82a70a36c8a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.030671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8e4ea8e506442aa086d82a70a36c8a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:05.035756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:05.087755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:05.131765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1106/2196] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:05.132954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:05.134354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.158993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62bef5-75f7-49b2-a3da-a1fe564a2353 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:05.163915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:05.164590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.164871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.165148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] PATH_INFO: `/v3/projects/2a33d16da6604ea1b9cb7858dc315b0a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.166567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a33d16da6604ea1b9cb7858dc315b0a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:05.169019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:05.260003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8e4ea8e506442aa086d82a70a36c8a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.260666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8e4ea8e506442aa086d82a70a36c8a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.273482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8e4ea8e506442aa086d82a70a36c8a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.287450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a33d16da6604ea1b9cb7858dc315b0a', 'request_id': 'req-b83631dd-69b0-4340-b1d7-fbc34204815c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.292769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a33d16da6604ea1b9cb7858dc315b0a', 'request_id': 'req-b83631dd-69b0-4340-b1d7-fbc34204815c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.389297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8e4ea8e506442aa086d82a70a36c8a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.390082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8e4ea8e506442aa086d82a70a36c8a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.403542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1091/2197] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:04 2022] DELETE /identity/v3/users/8c8e4ea8e506442aa086d82a70a36c8a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:05.404654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:05.406527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.463434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbb4a-9375-4528-98ec-c6d542e3c55c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:05.467024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87a172-5aff-489e-be5a-587d826d2149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:05.467636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a172-5aff-489e-be5a-587d826d2149 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.467920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a172-5aff-489e-be5a-587d826d2149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.468721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a172-5aff-489e-be5a-587d826d2149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.470477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1d87a172-5aff-489e-be5a-587d826d2149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.534805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87a172-5aff-489e-be5a-587d826d2149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:05.536378 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87a172-5aff-489e-be5a-587d826d2149 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:05.538607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a33d16da6604ea1b9cb7858dc315b0a', 'request_id': 'req-b83631dd-69b0-4340-b1d7-fbc34204815c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.547345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1092/2198] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:05.548596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.549032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.549553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.553435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] The token cache is being invalidate because project 2a33d16da6604ea1b9cb7858dc315b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:05.553945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.554673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b83631dd-69b0-4340-b1d7-fbc34204815c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:05.559538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1107/2199] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:05 2022] DELETE /identity/v3/projects/2a33d16da6604ea1b9cb7858dc315b0a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:05.560906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7e4c3-b773-4b14-9e97-c5baf8663c46 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.561194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7e4c3-b773-4b14-9e97-c5baf8663c46 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.561474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7e4c3-b773-4b14-9e97-c5baf8663c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.578913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:05.580966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.586780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d0c7e4c3-b773-4b14-9e97-c5baf8663c46 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:05.588097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d0c7e4c3-b773-4b14-9e97-c5baf8663c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.648798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1093/2200] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:05.655389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1108/2201] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:05.666789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:05.667513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fc38-435b-47ce-a1cf-24496341500b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.667989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fc38-435b-47ce-a1cf-24496341500b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.668495 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fc38-435b-47ce-a1cf-24496341500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.668615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.705174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e828fc38-435b-47ce-a1cf-24496341500b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:05.706929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e828fc38-435b-47ce-a1cf-24496341500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:05.726071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1109/2202] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:05.726071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828fc38-435b-47ce-a1cf-24496341500b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:05.739051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828fc38-435b-47ce-a1cf-24496341500b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:05.744640 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:05.745265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.745613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.745930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.747356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:05.747356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:05.748889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:05.753197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27749ad-56bf-4551-b92f-d91905e4b6da None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:05.757051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:05.757804 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.758182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.758560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.766468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1110/2203] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:24:05.767705 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:05.769786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:05.772250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:05.780237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13524c-12e6-4970-ba57-856886758049 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:05.784255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1094/2204] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:05.785437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:05.786147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:05.786440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:05.794047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:05.797647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:05.801963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:05.858244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:05.927204 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1111/2205] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:05 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:05.928624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:05.939877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221932-ea1f-4f7b-9b0b-5c090faf8732 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.001077 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.001709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.002021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.002300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.002973 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.004943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.110085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1095/2206] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:05 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:06.114219 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.125005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f5598-cbb7-4ed9-9181-5c8d2ace4262 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.129864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.130566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.130943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.131273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.132042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.133979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.145780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1112/2207] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:06.148575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.160507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030384be-8f57-4298-857c-44e20d9ccf67 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.165570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.166293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.166558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.166824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.167608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.169223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.180261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1096/2208] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:06.184424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.197934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96e58-ca83-483e-b68d-c7cdf506c921 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.203924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e2f35-97db-4da8-b81a-6dd6f6c40d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.204624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2f35-97db-4da8-b81a-6dd6f6c40d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.204916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2f35-97db-4da8-b81a-6dd6f6c40d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.205196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2f35-97db-4da8-b81a-6dd6f6c40d99 admin admin] PATH_INFO: `/v3/projects/7ebbb1238b6d4d1da72e38dfbbe7a601/users/dc6d28e0b2bb4ee3bf261e7d2b522cda/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.223801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e2f35-97db-4da8-b81a-6dd6f6c40d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebbb1238b6d4d1da72e38dfbbe7a601, user_id=dc6d28e0b2bb4ee3bf261e7d2b522cda, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.226565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e2f35-97db-4da8-b81a-6dd6f6c40d99 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.265010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.267444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:06.288737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6319c-849e-434d-af11-40f412c88041 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.293983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1113/2209] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:06 2022] PUT /identity/v3/projects/7ebbb1238b6d4d1da72e38dfbbe7a601/users/dc6d28e0b2bb4ee3bf261e7d2b522cda/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:06.305287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd30b3-c461-4b0f-8596-32953cc0ddec None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.305580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd30b3-c461-4b0f-8596-32953cc0ddec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.305884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd30b3-c461-4b0f-8596-32953cc0ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.351750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-69cd30b3-c461-4b0f-8596-32953cc0ddec None None] MFA Rules not processed for user `dc6d28e0b2bb4ee3bf261e7d2b522cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:06.353026 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-69cd30b3-c461-4b0f-8596-32953cc0ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:06.409854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.410583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.411193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.411193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] PATH_INFO: `/v3/projects/86ab181f8974478486a2ebb37935b0c1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.412327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ab181f8974478486a2ebb37935b0c1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.415150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.442435 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1114/2210] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:06.443410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd30b3-c461-4b0f-8596-32953cc0ddec None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.458943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd30b3-c461-4b0f-8596-32953cc0ddec None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.462799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.463457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.463744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.464025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.464880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.469796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.602299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ab181f8974478486a2ebb37935b0c1', 'request_id': 'req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:06.608369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ab181f8974478486a2ebb37935b0c1', 'request_id': 'req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:06.614182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ab181f8974478486a2ebb37935b0c1', 'request_id': 'req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:06.660789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1115/2211] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:06 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:06.667344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.720503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] The token cache is being invalidate because project 86ab181f8974478486a2ebb37935b0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:06.721037 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:06.721921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:06.723797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1097/2212] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:06 2022] DELETE /identity/v3/projects/86ab181f8974478486a2ebb37935b0c1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:06.735234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.741787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:06.746936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331361-f61f-48c1-9c0f-208d60eeaacd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.759628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.760371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.760829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.765971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.765971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.767685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.844348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d6ee-b5ab-4a7e-a0db-1d57f9bb4696 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.847153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1116/2213] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:06 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:06.850723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:06.851778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.852524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:06.852631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.852858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.853205 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] PATH_INFO: `/v3/users/1d58cf8fcf844b1fa1f9635045e2274b` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.854501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d58cf8fcf844b1fa1f9635045e2274b)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.856624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.865568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30cdc-7af9-48ed-a183-a8d4c8cbe775 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:06.871053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:06.871373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:06.871655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:06.871937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] PATH_INFO: `/v3/users/b881e2fb57cb4819836b8115ac43396e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:06.873409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b881e2fb57cb4819836b8115ac43396e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:06.876731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:06.894071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:07.108795 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d58cf8fcf844b1fa1f9635045e2274b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.109964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b881e2fb57cb4819836b8115ac43396e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.110508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b881e2fb57cb4819836b8115ac43396e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.110638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d58cf8fcf844b1fa1f9635045e2274b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.123691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d58cf8fcf844b1fa1f9635045e2274b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.123864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b881e2fb57cb4819836b8115ac43396e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.131080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b881e2fb57cb4819836b8115ac43396e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.171873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d58cf8fcf844b1fa1f9635045e2274b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.172468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d58cf8fcf844b1fa1f9635045e2274b'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.185166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1098/2214] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:06 2022] DELETE /identity/v3/users/1d58cf8fcf844b1fa1f9635045e2274b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:07.185974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:07.187624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.246193 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-93a9a8eb-ac10-4c80-8e7b-2e157d8de900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b881e2fb57cb4819836b8115ac43396e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:07.254182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1117/2215] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:06 2022] DELETE /identity/v3/users/b881e2fb57cb4819836b8115ac43396e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:07.254354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9754b-7897-4a51-b292-603328f24e18 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:07.258360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.258660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.258927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.281523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:07.282986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.319274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:07.319949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.320227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.320511 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.321214 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:07.322891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:07.333806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1099/2216] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:07.337892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:07.339652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.349225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1118/2217] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:07.361317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f861-5a6b-4816-95eb-5a50fac37907 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:07.361679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:07.361679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.364834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:07.365985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.365985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.366199 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] PATH_INFO: `/v3/projects/0cf920a8a9f54cf981e0f80021508f99/users/bd08cca2602748b2acc40bad3599f2cb/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.392092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf920a8a9f54cf981e0f80021508f99, user_id=bd08cca2602748b2acc40bad3599f2cb, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:07.421751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:07.455932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c4033-b74b-4b16-a9ef-33fe16859bc1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:07.460599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792caf7-ea6f-45dc-a942-eb7033647099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:07.461312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792caf7-ea6f-45dc-a942-eb7033647099 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.461833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792caf7-ea6f-45dc-a942-eb7033647099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.462183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792caf7-ea6f-45dc-a942-eb7033647099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.473923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792caf7-ea6f-45dc-a942-eb7033647099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:07.475668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792caf7-ea6f-45dc-a942-eb7033647099 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:07.489201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1119/2218] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:07.491596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0dd0-ca96-40a9-bab4-cfd57e8541d3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.491941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0dd0-ca96-40a9-bab4-cfd57e8541d3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.496708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0dd0-ca96-40a9-bab4-cfd57e8541d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.512381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c35a0dd0-ca96-40a9-bab4-cfd57e8541d3 None None] MFA Rules not processed for user `df8374b04fd142a8a97503e0a0774960`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:07.513688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c35a0dd0-ca96-40a9-bab4-cfd57e8541d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.550889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1100/2219] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:07 2022] PUT /identity/v3/projects/0cf920a8a9f54cf981e0f80021508f99/users/bd08cca2602748b2acc40bad3599f2cb/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:07.554704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:07.580943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1120/2220] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:07.620428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4aa557-c995-4c52-bcda-71bb9b19b7f2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:07.625486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:07.626136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.626440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.626842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.627543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:07.629292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:07.643185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1101/2221] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:07.644306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a0dd0-ca96-40a9-bab4-cfd57e8541d3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:07.655091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a0dd0-ca96-40a9-bab4-cfd57e8541d3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:07.660524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c079-0e83-4c40-9950-02c6c19dd26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:07.661309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c079-0e83-4c40-9950-02c6c19dd26c admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.661711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c079-0e83-4c40-9950-02c6c19dd26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.662086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c079-0e83-4c40-9950-02c6c19dd26c admin admin] PATH_INFO: `/v3/projects/0cf920a8a9f54cf981e0f80021508f99/users/bd08cca2602748b2acc40bad3599f2cb/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.664157 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748c079-0e83-4c40-9950-02c6c19dd26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf920a8a9f54cf981e0f80021508f99, user_id=bd08cca2602748b2acc40bad3599f2cb, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:07.667021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748c079-0e83-4c40-9950-02c6c19dd26c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:07.675289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:07.679402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1121/2222] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:07 2022] PUT /identity/v3/projects/0cf920a8a9f54cf981e0f80021508f99/users/bd08cca2602748b2acc40bad3599f2cb/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:07.690011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.690307 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.690597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.694597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:07.698729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.725098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] MFA Rules not processed for user `bd08cca2602748b2acc40bad3599f2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:07.726407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.729423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae3960-ca42-47ff-b5da-b72aee2b9567 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:07.804808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1122/2223] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:07.811980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:07.813250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.813605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.815014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] PATH_INFO: `/v3/projects/9eb1efbf3519426b93e1d480c1dabd5a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.816642 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb1efbf3519426b93e1d480c1dabd5a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:07.818831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:07.819855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:07.820562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:07.918358 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515be69-cf95-411b-849a-cae8aabbc1d0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:07.926057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305fb59-c741-4742-a379-3082a1bd17ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:07.926808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305fb59-c741-4742-a379-3082a1bd17ac service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.927168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305fb59-c741-4742-a379-3082a1bd17ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.927538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305fb59-c741-4742-a379-3082a1bd17ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.956595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305fb59-c741-4742-a379-3082a1bd17ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:07.957601 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305fb59-c741-4742-a379-3082a1bd17ac service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:07.976421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1123/2224] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:07.977982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f75f9-90a4-405f-a842-425fece346cb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:07.978459 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f75f9-90a4-405f-a842-425fece346cb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:07.979335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f75f9-90a4-405f-a842-425fece346cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8c1f75f9-90a4-405f-a842-425fece346cb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:24:07.988636 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:24:07.989491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:24:07.993227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1124/2225] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:24:07 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:24:08.002312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb1efbf3519426b93e1d480c1dabd5a', 'request_id': 'req-145f5c88-65fd-404b-a4b0-cad42078622c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.012435 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb1efbf3519426b93e1d480c1dabd5a', 'request_id': 'req-145f5c88-65fd-404b-a4b0-cad42078622c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.030164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb1efbf3519426b93e1d480c1dabd5a', 'request_id': 'req-145f5c88-65fd-404b-a4b0-cad42078622c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.030743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424addcd-5617-4826-847d-12341e3da51a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.031070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424addcd-5617-4826-847d-12341e3da51a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.031352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424addcd-5617-4826-847d-12341e3da51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.072398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-424addcd-5617-4826-847d-12341e3da51a None None] MFA Rules not processed for user `df8374b04fd142a8a97503e0a0774960`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:08.074721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-424addcd-5617-4826-847d-12341e3da51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:08.124465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] The token cache is being invalidate because project 9eb1efbf3519426b93e1d480c1dabd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:08.124983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.125628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.127336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1102/2226] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:07 2022] DELETE /identity/v3/projects/9eb1efbf3519426b93e1d480c1dabd5a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:08.128088 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:08.129761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:08.175733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1125/2227] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:08.175733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.175733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.175733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.204430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:08.205669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:08.255039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f5c88-65fd-404b-a4b0-cad42078622c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:08.261320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:08.274811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.275271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.275379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1126/2228] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:08.275774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] PATH_INFO: `/v3/users/dc6d28e0b2bb4ee3bf261e7d2b522cda` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.276155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:08.277529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:08.283290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6d28e0b2bb4ee3bf261e7d2b522cda)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:08.286232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:08.291612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd403371-6d3f-40a4-b7bf-e21390062667 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:08.298767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:08.299438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.300370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.300693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] PATH_INFO: `/v3/users/2c59cf373e8b4f99904e6983e6986597` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.302363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c59cf373e8b4f99904e6983e6986597)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:08.305241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:08.463577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:08.608564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6d28e0b2bb4ee3bf261e7d2b522cda'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.608915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c59cf373e8b4f99904e6983e6986597'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.609277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6d28e0b2bb4ee3bf261e7d2b522cda'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.609580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c59cf373e8b4f99904e6983e6986597'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.622201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c59cf373e8b4f99904e6983e6986597'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.623905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6d28e0b2bb4ee3bf261e7d2b522cda'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.630180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c59cf373e8b4f99904e6983e6986597'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.708363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6d28e0b2bb4ee3bf261e7d2b522cda'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.709017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6d28e0b2bb4ee3bf261e7d2b522cda'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.726553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1103/2229] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:08 2022] DELETE /identity/v3/users/dc6d28e0b2bb4ee3bf261e7d2b522cda => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:08.729609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:08.729609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:08.810873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d313a-3e33-481c-bde8-197e1c0de4c4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:08.816071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-42783429-6ebd-4801-8277-f35972227a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c59cf373e8b4f99904e6983e6986597'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.818454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:08.819112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.819400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.822829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1127/2230] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:08 2022] DELETE /identity/v3/users/2c59cf373e8b4f99904e6983e6986597 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:08.822941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] PATH_INFO: `/v3/projects/32f167d8fb874b568a7cf8af11a7e3ee` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.823021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3104ea-d4b0-4cd7-8b47-46764227f241 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.823021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3104ea-d4b0-4cd7-8b47-46764227f241 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.823021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3104ea-d4b0-4cd7-8b47-46764227f241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.823471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f167d8fb874b568a7cf8af11a7e3ee)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:08.825397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:08.842342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3b3104ea-d4b0-4cd7-8b47-46764227f241 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:08.843782 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3b3104ea-d4b0-4cd7-8b47-46764227f241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:08.922124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1128/2231] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:08.923663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3ecc-bf2f-44be-b949-af57639dba14 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.924164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3ecc-bf2f-44be-b949-af57639dba14 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.924457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3ecc-bf2f-44be-b949-af57639dba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-229d3ecc-bf2f-44be-b949-af57639dba14 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:24:08.932602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:24:08.943599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:24:08.945826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1129/2232] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:24:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:24:08.945826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b2b2d-5f8d-4eaa-b54c-5ea93b9e437f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:08.945826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b2b2d-5f8d-4eaa-b54c-5ea93b9e437f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:08.945826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b2b2d-5f8d-4eaa-b54c-5ea93b9e437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:08.975348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6c5b2b2d-5f8d-4eaa-b54c-5ea93b9e437f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:08.976724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6c5b2b2d-5f8d-4eaa-b54c-5ea93b9e437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:08.977344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f167d8fb874b568a7cf8af11a7e3ee', 'request_id': 'req-2317798c-e2f3-436c-b351-db54e2728a23'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.985131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f167d8fb874b568a7cf8af11a7e3ee', 'request_id': 'req-2317798c-e2f3-436c-b351-db54e2728a23'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:08.991946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f167d8fb874b568a7cf8af11a7e3ee', 'request_id': 'req-2317798c-e2f3-436c-b351-db54e2728a23'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.051158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1130/2233] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:09.054506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.054506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.054506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.056978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] The token cache is being invalidate because project 32f167d8fb874b568a7cf8af11a7e3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:09.057289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.058203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.060021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1104/2234] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:08 2022] DELETE /identity/v3/projects/32f167d8fb874b568a7cf8af11a7e3ee => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:09.060601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.061981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:09.075962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317798c-e2f3-436c-b351-db54e2728a23 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.081863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.082512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.082790 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.083064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.084042 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:09.084948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.085054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:09.086243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:09.086732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.095077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1131/2235] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:09.095756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.097096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:09.107721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1105/2236] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:09.109928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86987c2-71d0-49c4-8f9e-bc67705ff036 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.110868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.114124 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:09.125919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.125919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.125919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.125919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] PATH_INFO: `/v3/users/e1df3ba3b55945a9829c93a226d67fa3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.126284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1df3ba3b55945a9829c93a226d67fa3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.126284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.191888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11acb1-d3b9-4641-9b11-ddcca4b2dbd0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.195627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.196263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.196529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.196808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.198840 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:09.211657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.213025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.223376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1106/2237] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:09.224163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.236230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eeee5-3e96-448c-adcf-8fc8c7b2bc12 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.240135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.240754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.241057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.241328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.254027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.255525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.266982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1107/2238] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:09.267897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.278574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668636ca-5fd1-42cd-96b0-61f614d73c5a service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.285662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.286346 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.286636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.286920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.287592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.289695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.321586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:09.345265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1df3ba3b55945a9829c93a226d67fa3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.346202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1df3ba3b55945a9829c93a226d67fa3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.359402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1df3ba3b55945a9829c93a226d67fa3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.367068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1df3ba3b55945a9829c93a226d67fa3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.374388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1108/2239] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:09 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:09.379154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.449039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b81fff-80ad-4dc0-9486-bb5733fb44f2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.454893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.455683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.456083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.456512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.457295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.459406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.471342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1df3ba3b55945a9829c93a226d67fa3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.478260 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1132/2240] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:09 2022] DELETE /identity/v3/users/e1df3ba3b55945a9829c93a226d67fa3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:09.555432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.557007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:09.569186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1109/2241] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:09 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:09.573527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.575742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:09.592371 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2cfe6-43e0-4422-913f-099577f65064 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.649005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb26a6a-a757-472c-a5ed-9f16d23263e4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.664847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.664847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.664847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.664847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] PATH_INFO: `/v3/users/d97daca6a6114ddb8149e260dba20189` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.666883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97daca6a6114ddb8149e260dba20189)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.668330 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.682779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.685675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.686651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.687014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.693224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.693224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.707021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1110/2242] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:09.711209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.743495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d29820-ded0-41dd-a9d6-03928174ab1d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.752319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.753292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.753899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.754201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.754915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.756786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.790318 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1111/2243] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:09.807113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:09.820009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c532af5-ebca-4d6f-b032-9ef8024fa0a6 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:09.826487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:09.827381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:09.827744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:09.828537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] PATH_INFO: `/v3/projects/3d8f110e13f3451091ed5510c9a3fdeb/users/bdbec54572cd419db1a283a72ea5a1c4/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:09.854410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8f110e13f3451091ed5510c9a3fdeb, user_id=bdbec54572cd419db1a283a72ea5a1c4, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:09.858147 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:09.929208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97daca6a6114ddb8149e260dba20189'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.929208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97daca6a6114ddb8149e260dba20189'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.964450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97daca6a6114ddb8149e260dba20189'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.992479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97daca6a6114ddb8149e260dba20189'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:09.996531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1112/2244] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:09 2022] PUT /identity/v3/projects/3d8f110e13f3451091ed5510c9a3fdeb/users/bdbec54572cd419db1a283a72ea5a1c4/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:09.998249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:10.002971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.089131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7be97-b250-4bce-ba68-a4a791fba305 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:10.091971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-0055c4c3-7a5a-40b4-9129-66a08f05411e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97daca6a6114ddb8149e260dba20189'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.096771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:10.097842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.098192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.100509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] PATH_INFO: `/v3/projects/9854420dcb734c288da6bb1add68868d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.100509 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9854420dcb734c288da6bb1add68868d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:10.101940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:10.104035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1133/2245] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:09 2022] DELETE /identity/v3/users/d97daca6a6114ddb8149e260dba20189 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:10.105438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.105761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.106043 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.147296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:10.149625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.218958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1134/2246] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:10.222538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:10.222538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.232783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143cbf9-ad69-4e6e-87e7-9bac6834495c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:10.237872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:10.242201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.242201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.242201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] PATH_INFO: `/v3/projects/7ebbb1238b6d4d1da72e38dfbbe7a601` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.242201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebbb1238b6d4d1da72e38dfbbe7a601)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:10.244338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:10.263062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:10.282955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9854420dcb734c288da6bb1add68868d', 'request_id': 'req-acf647f1-a810-46e7-b017-4149302ef7c0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.289555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9854420dcb734c288da6bb1add68868d', 'request_id': 'req-acf647f1-a810-46e7-b017-4149302ef7c0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.295098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9854420dcb734c288da6bb1add68868d', 'request_id': 'req-acf647f1-a810-46e7-b017-4149302ef7c0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.412302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] The token cache is being invalidate because project 9854420dcb734c288da6bb1add68868d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:10.412600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.413250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.415164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1113/2247] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:09 2022] DELETE /identity/v3/projects/9854420dcb734c288da6bb1add68868d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:10.415809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:10.419204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.428656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebbb1238b6d4d1da72e38dfbbe7a601', 'request_id': 'req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.435744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebbb1238b6d4d1da72e38dfbbe7a601', 'request_id': 'req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.497270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf647f1-a810-46e7-b017-4149302ef7c0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:10.516181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebbb1238b6d4d1da72e38dfbbe7a601', 'request_id': 'req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.528838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] The token cache is being invalidate because project 7ebbb1238b6d4d1da72e38dfbbe7a601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:10.529132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.529833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ee2acc6f-66c1-44ab-a792-c8a6d55a3b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.532670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1135/2248] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:10 2022] DELETE /identity/v3/projects/7ebbb1238b6d4d1da72e38dfbbe7a601 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:10.534155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.534612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.535036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.555419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:10.557046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.563869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:10.564644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.565073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.565427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] PATH_INFO: `/v3/projects/2337da90c33a41daafc53eaf1a3b8e02` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.566990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2337da90c33a41daafc53eaf1a3b8e02)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:10.569188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:10.643557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1136/2249] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:10.644544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:10.649611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.698497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2337da90c33a41daafc53eaf1a3b8e02', 'request_id': 'req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.705182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2337da90c33a41daafc53eaf1a3b8e02', 'request_id': 'req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.706496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220e1ab-5446-4857-a8c3-b3dc81654301 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:10.710940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2337da90c33a41daafc53eaf1a3b8e02', 'request_id': 'req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.758301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:10.758854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.759136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.759408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.761147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.800843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] The token cache is being invalidate because project 2337da90c33a41daafc53eaf1a3b8e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:10.801130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.801808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:10.803340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1114/2250] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:10 2022] DELETE /identity/v3/projects/2337da90c33a41daafc53eaf1a3b8e02 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:10.804287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:10.807965 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.826341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:10.828066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:10.838335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1137/2251] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:10.843821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:10.843821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:10.852146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3e0f4-1731-40d1-addd-0ff07c0311d3 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:10.857530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:10.858218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.858502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.859560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] PATH_INFO: `/v3/users/bd08cca2602748b2acc40bad3599f2cb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.860778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd08cca2602748b2acc40bad3599f2cb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:10.862813 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:10.883978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530ffaf-dc57-4ce5-9c3d-1fe045127e1a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:10.888723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:10.890881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:10.890881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:10.890881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] PATH_INFO: `/v3/users/07b41f0a2658410d848d6c7dda42583e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:10.891296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b41f0a2658410d848d6c7dda42583e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:10.893387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:11.066890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b41f0a2658410d848d6c7dda42583e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.067169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd08cca2602748b2acc40bad3599f2cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.068067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd08cca2602748b2acc40bad3599f2cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.068187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b41f0a2658410d848d6c7dda42583e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.082573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b41f0a2658410d848d6c7dda42583e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.092943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd08cca2602748b2acc40bad3599f2cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.100281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd08cca2602748b2acc40bad3599f2cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.149497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b41f0a2658410d848d6c7dda42583e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.150164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b41f0a2658410d848d6c7dda42583e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.164578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1115/2252] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:10 2022] DELETE /identity/v3/users/07b41f0a2658410d848d6c7dda42583e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:11.165260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:11.167035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:11.235410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d158293d-c9cd-42dc-8d53-adca362f7a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd08cca2602748b2acc40bad3599f2cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:11.247381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1138/2253] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:10 2022] DELETE /identity/v3/users/bd08cca2602748b2acc40bad3599f2cb => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:11.248915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c303-8c40-444f-a69f-cfd5f809d3f0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.249199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c303-8c40-444f-a69f-cfd5f809d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.249514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c303-8c40-444f-a69f-cfd5f809d3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.251707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576591a8-4e27-452d-a500-09987238af6b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:11.271722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7471c303-8c40-444f-a69f-cfd5f809d3f0 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:11.273061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7471c303-8c40-444f-a69f-cfd5f809d3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:11.312075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:11.313347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.313627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.313935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.315835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:11.349521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1139/2254] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:11.351321 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9cd0-a37c-42a1-b930-b229a9005853 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.352106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9cd0-a37c-42a1-b930-b229a9005853 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.352460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9cd0-a37c-42a1-b930-b229a9005853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.368036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:11.375354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2c4c9cd0-a37c-42a1-b930-b229a9005853 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:11.377882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2c4c9cd0-a37c-42a1-b930-b229a9005853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:11.390148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1140/2255] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:11.396634 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c9cd0-a37c-42a1-b930-b229a9005853 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:11.413984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:11.416757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:11.418328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c9cd0-a37c-42a1-b930-b229a9005853 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:11.432031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee83163-a20d-4067-bc3f-e35f361ddf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:11.440161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee83163-a20d-4067-bc3f-e35f361ddf9c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.440161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee83163-a20d-4067-bc3f-e35f361ddf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.440161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee83163-a20d-4067-bc3f-e35f361ddf9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.440161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee83163-a20d-4067-bc3f-e35f361ddf9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:11.440161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee83163-a20d-4067-bc3f-e35f361ddf9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:11.440161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee83163-a20d-4067-bc3f-e35f361ddf9c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:11.441271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1116/2256] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:11.465071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1141/2257] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:11.466727 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:11.478543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f29b2-dffd-4f7c-af1d-f5fad1f657f7 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:11.485261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:11.486005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.486563 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.486909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.487732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:11.491317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:11.624982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1117/2258] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:11 2022] POST /identity/v3/projects => generated 409 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:11.626267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.627113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.627615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:11.627990 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.680733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:11.682226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:11.779466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb5093-63b1-4422-8fc2-516f06ac2d55 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:11.794171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:11.797507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.797826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.798117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.798843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:11.800803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:11.813520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1142/2259] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:11.817681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:11.819562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:11.940041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1118/2260] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:11 2022] POST /identity/v3/users => generated 305 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:11.940989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:11.946621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:11.964883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9ecc-df20-4b30-bba7-8d7255c2574b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:11.969828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:11.970774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:11.971305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:11.971852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] PATH_INFO: `/v3/projects/1c2f6d9f0e7f46d9bb0f07012f2596f0` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:11.973453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2f6d9f0e7f46d9bb0f07012f2596f0)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:11.976532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:12.026823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25393b0-d7b6-4026-ae9d-f66dd17831a9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:12.035351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:12.036100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.036526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.036823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.046371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:12.048131 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:12.056976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1143/2261] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:24:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:24:12.057889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:12.073108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55e626-b47a-448f-8415-aa7f6f754c2d service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:12.085460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2f6d9f0e7f46d9bb0f07012f2596f0', 'request_id': 'req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.093349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2f6d9f0e7f46d9bb0f07012f2596f0', 'request_id': 'req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.100196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2f6d9f0e7f46d9bb0f07012f2596f0', 'request_id': 'req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.163055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:12.163688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.163975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.164257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.165009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:12.168124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:12.180230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] The token cache is being invalidate because project 1c2f6d9f0e7f46d9bb0f07012f2596f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:12.180230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.180230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.181301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1144/2262] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:12.181699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1119/2263] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:11 2022] DELETE /identity/v3/projects/1c2f6d9f0e7f46d9bb0f07012f2596f0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:12.182492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:12.185553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:12.188484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:12.196319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:12.203918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea7c8-c6ca-4c64-bbf2-3476dfc22738 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:12.209553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:12.210254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.210542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.210824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] PATH_INFO: `/v3/projects/9a520b8535d04e39991d68bc1fed1b21` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.212014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a520b8535d04e39991d68bc1fed1b21)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:12.214060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:12.234807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c5515-68fc-44a1-8b6c-0a8769cf7f60 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:12.243011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:12.243743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.244028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.244564 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] PATH_INFO: `/v3/projects/0cf920a8a9f54cf981e0f80021508f99` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.246197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf920a8a9f54cf981e0f80021508f99)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:12.248189 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:12.394630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a520b8535d04e39991d68bc1fed1b21', 'request_id': 'req-a57f91f1-2dd1-421e-bb74-b71733b1aa62'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.400698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a520b8535d04e39991d68bc1fed1b21', 'request_id': 'req-a57f91f1-2dd1-421e-bb74-b71733b1aa62'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.444028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf920a8a9f54cf981e0f80021508f99', 'request_id': 'req-1c583bec-bd00-40b1-bf9a-75775ec16e05'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.460000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf920a8a9f54cf981e0f80021508f99', 'request_id': 'req-1c583bec-bd00-40b1-bf9a-75775ec16e05'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.469308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf920a8a9f54cf981e0f80021508f99', 'request_id': 'req-1c583bec-bd00-40b1-bf9a-75775ec16e05'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.552452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a520b8535d04e39991d68bc1fed1b21', 'request_id': 'req-a57f91f1-2dd1-421e-bb74-b71733b1aa62'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.565900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] The token cache is being invalidate because project 9a520b8535d04e39991d68bc1fed1b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:12.566344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.567487 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.569112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1145/2264] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:12 2022] DELETE /identity/v3/projects/9a520b8535d04e39991d68bc1fed1b21 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:12.572916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:12.574577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:12.606780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:12.649281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] The token cache is being invalidate because project 0cf920a8a9f54cf981e0f80021508f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:12.649281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.649281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c583bec-bd00-40b1-bf9a-75775ec16e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:12.650131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1120/2265] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:12 2022] DELETE /identity/v3/projects/0cf920a8a9f54cf981e0f80021508f99 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:12.652470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34011b4-c6d3-464d-9a3a-49e935916c3f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.652823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34011b4-c6d3-464d-9a3a-49e935916c3f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.653169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34011b4-c6d3-464d-9a3a-49e935916c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.666894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f91f1-2dd1-421e-bb74-b71733b1aa62 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:12.686343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e34011b4-c6d3-464d-9a3a-49e935916c3f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:12.688044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e34011b4-c6d3-464d-9a3a-49e935916c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:12.784018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:12.784955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.785239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.785512 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.786396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:12.788905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:12.802557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1146/2266] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:12.803888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:12.805898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:12.817706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1121/2267] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:12.819298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fd1b0-4b39-46bc-ac33-3f0bc17e7f10 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.819690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fd1b0-4b39-46bc-ac33-3f0bc17e7f10 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.820102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fd1b0-4b39-46bc-ac33-3f0bc17e7f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.840915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150652d-c664-4fff-aef1-b7125a41fa71 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:12.848579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f52fd1b0-4b39-46bc-ac33-3f0bc17e7f10 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:12.849946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f52fd1b0-4b39-46bc-ac33-3f0bc17e7f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:12.852774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:12.853872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.856176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.861271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] PATH_INFO: `/v3/users/972b8c98e5ce48978155e569213fe70e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.861271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=972b8c98e5ce48978155e569213fe70e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:12.863741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:12.868149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1122/2268] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:12.869869 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:12.870222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:12.871414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:12.922671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] MFA Rules not processed for user `bdbec54572cd419db1a283a72ea5a1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:12.924036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:13.035324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1123/2269] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:13.035324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:13.036670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:13.054421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8e398-c8e4-4d20-b17e-c408d7aa51ff None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:13.069550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3ee3-80e9-4991-99a3-e444762e5f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:13.070620 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3ee3-80e9-4991-99a3-e444762e5f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:13.070915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3ee3-80e9-4991-99a3-e444762e5f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:13.071200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3ee3-80e9-4991-99a3-e444762e5f15 admin admin] PATH_INFO: `/v3/projects/52dbe426b2c9419f8ecf31717c1c0941/users/436ff060cb774f15913142a8f14b6c6f/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:13.109544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3ee3-80e9-4991-99a3-e444762e5f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dbe426b2c9419f8ecf31717c1c0941, user_id=436ff060cb774f15913142a8f14b6c6f, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:13.109544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3ee3-80e9-4991-99a3-e444762e5f15 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:13.147456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972b8c98e5ce48978155e569213fe70e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:13.148186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972b8c98e5ce48978155e569213fe70e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:13.170504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972b8c98e5ce48978155e569213fe70e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:13.190619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972b8c98e5ce48978155e569213fe70e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:13.763106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9bd69b78-f2bb-403f-b5df-6980ed416eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972b8c98e5ce48978155e569213fe70e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:13.772801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1124/2271] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:13 2022] PUT /identity/v3/projects/52dbe426b2c9419f8ecf31717c1c0941/users/436ff060cb774f15913142a8f14b6c6f/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:13.773392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1147/2271] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:12 2022] DELETE /identity/v3/users/972b8c98e5ce48978155e569213fe70e => generated 0 bytes in 969 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:13.775188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70365183-310a-48d6-b699-f5c42c2f9813 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:13.775342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:13.775963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70365183-310a-48d6-b699-f5c42c2f9813 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:13.776104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:13.776397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:13.776686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70365183-310a-48d6-b699-f5c42c2f9813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:13.810349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:13.814127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:13.815025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-70365183-310a-48d6-b699-f5c42c2f9813 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:13.818162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-70365183-310a-48d6-b699-f5c42c2f9813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:13.969812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1125/2272] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:13.970618 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:13.971612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:14.007156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cc933-38b0-4003-b755-3a23289fafad None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.007257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1148/2273] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:14.007257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e36607-cd7f-4e13-8052-659eea6879ed None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.007257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e36607-cd7f-4e13-8052-659eea6879ed None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.007257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e36607-cd7f-4e13-8052-659eea6879ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.009299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.010668 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.011297 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.011879 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.013175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.015891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.028390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f8e36607-cd7f-4e13-8052-659eea6879ed None None] MFA Rules not processed for user `436ff060cb774f15913142a8f14b6c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:14.029711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f8e36607-cd7f-4e13-8052-659eea6879ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:14.126459 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1149/2274] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:14.127462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e36607-cd7f-4e13-8052-659eea6879ed None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.144126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e36607-cd7f-4e13-8052-659eea6879ed None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.150825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1126/2275] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:13 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:14.150825 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.241423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca823-0e0b-46b3-8a3e-e217035ec890 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.248244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.249130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.249895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.250285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.251006 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:14.251495 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.253208 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.277287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.277605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1127/2276] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:14.278254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.278691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.278975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.279354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.282154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:14.282755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.284536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:14.285288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.304453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1150/2277] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:14.305949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.306156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969a8e-59fb-47c1-af85-4db0d4dda1b0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.314703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.315818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.316163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.316504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.317754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.322766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d689-ba8f-445b-8b43-11203f4724d4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.322910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.324358 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.325098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.325603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.326551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.327377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.329563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.436006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1151/2278] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:14 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:14.437188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.448800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3e30-7eed-437c-8cc3-1d21e13b5bc5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.454309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.455835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.455835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.455835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.456421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.458577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.491183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1128/2279] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:14 2022] POST /identity/v3/projects => generated 407 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:14.491183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.565100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb58a57-51ae-4fd8-b455-829d309c0bdb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.570775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.571577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.571862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.572180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.572877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.575444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.591820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:14.603178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1152/2280] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:14 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:14.604177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.680121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81898981-04a3-47cc-ac21-50cb691be7aa admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.685552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.686327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.686830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.687133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.687917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.689647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.704188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1153/2281] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:14.704188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.706404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:14.715672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1129/2282] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:14 2022] POST /identity/v3/projects => generated 391 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:14.716980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.724720 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778bb7-5edb-4302-9bd9-940cfd6ae848 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.790262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.791706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.792175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.792454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] PATH_INFO: `/v3/projects/023b964bcaa34f0d96f617ab20dbfcda` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.794480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023b964bcaa34f0d96f617ab20dbfcda)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.797058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.800634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b838-2e39-4668-aa38-df2e3538477d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.806913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:14.807803 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:14.808233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:14.808582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:14.809298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:14.811465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:14.926299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1130/2283] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:14 2022] POST /identity/v3/users => generated 310 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:14.927038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:14.939587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd72f4-317a-4c95-8593-00d1933f9ade admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:14.956274 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023b964bcaa34f0d96f617ab20dbfcda', 'request_id': 'req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:14.961665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023b964bcaa34f0d96f617ab20dbfcda', 'request_id': 'req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:15.003451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.004099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.004499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.004659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.005325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.007336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.040493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023b964bcaa34f0d96f617ab20dbfcda', 'request_id': 'req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:15.054141 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] The token cache is being invalidate because project 023b964bcaa34f0d96f617ab20dbfcda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:15.054616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:15.055420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:15.057350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1154/2284] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:14 2022] DELETE /identity/v3/projects/023b964bcaa34f0d96f617ab20dbfcda => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:15.058518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.060180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:15.075631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c15d-70ad-49cf-8f34-90e8f9bbbec0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.082063 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.082963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.083425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.083710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] PATH_INFO: `/v3/projects/339211eaa93346f9b28e87790df038ce/users/603cc234019144e99ca7fb74cc87a0ef/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.101633 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339211eaa93346f9b28e87790df038ce, user_id=603cc234019144e99ca7fb74cc87a0ef, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.105537 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.119039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1131/2285] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:14 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:15.119930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.123342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:15.139046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b803b64-a01c-4c87-964b-21d247044673 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.145342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88661a6-720f-449e-b1ff-806da95b3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.146241 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88661a6-720f-449e-b1ff-806da95b3ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.147898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88661a6-720f-449e-b1ff-806da95b3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.147898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88661a6-720f-449e-b1ff-806da95b3ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.147898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88661a6-720f-449e-b1ff-806da95b3ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.150304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88661a6-720f-449e-b1ff-806da95b3ef7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.209622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1155/2286] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:15 2022] PUT /identity/v3/projects/339211eaa93346f9b28e87790df038ce/users/603cc234019144e99ca7fb74cc87a0ef/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:15.210935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.216788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:15.236874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1132/2287] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:15 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:15.239574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2f36b-cc04-4250-b023-c6df04dd9cc9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.239574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2f36b-cc04-4250-b023-c6df04dd9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.239574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2f36b-cc04-4250-b023-c6df04dd9cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.268949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2ef2f36b-cc04-4250-b023-c6df04dd9cc9 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:15.270977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2ef2f36b-cc04-4250-b023-c6df04dd9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:15.309314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302600f-a1a0-4bd3-bbc5-c82672e61329 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.316475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.317186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.317444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.317771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.318767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.331358 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.351381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1156/2288] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:15.352950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.356210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:15.376904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0996f0d-c698-4d27-996a-4fe546baffea admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.383381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:15.388757 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.391090 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.392167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.393704 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.394750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.395185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1133/2289] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:15.396288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2f36b-cc04-4250-b023-c6df04dd9cc9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.396836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.414129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1157/2290] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:15.416861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.418889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2f36b-cc04-4250-b023-c6df04dd9cc9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.429553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23c6cf-08d8-4ec7-8d53-b444eae97799 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.430570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.432458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.432754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.437451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.437451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.437788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38994ff-e51c-46ba-85b1-59b910d18e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.437788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38994ff-e51c-46ba-85b1-59b910d18e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.437788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38994ff-e51c-46ba-85b1-59b910d18e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.439049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38994ff-e51c-46ba-85b1-59b910d18e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.439912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38994ff-e51c-46ba-85b1-59b910d18e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.440052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.441804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38994ff-e51c-46ba-85b1-59b910d18e2a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.460592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1134/2291] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:15.461767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.473385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1158/2292] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:15.475051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae52a2-1150-4f5c-9836-39aa13b01596 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.475463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae52a2-1150-4f5c-9836-39aa13b01596 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.475857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae52a2-1150-4f5c-9836-39aa13b01596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.486265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad96c6-ada6-4f72-941d-b01330d30137 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.494518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.495734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.496179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.496755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] PATH_INFO: `/v3/projects/030255e4b76046daabe53dc560444953/users/40b86b4b684b4a638b50656189df8774/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.501344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-19ae52a2-1150-4f5c-9836-39aa13b01596 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:15.502737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19ae52a2-1150-4f5c-9836-39aa13b01596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:15.515667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1159/2293] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:15.516911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae52a2-1150-4f5c-9836-39aa13b01596 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.529301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae52a2-1150-4f5c-9836-39aa13b01596 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.536474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] RBAC: Authorizing `identity:create_grant(project_id=030255e4b76046daabe53dc560444953, user_id=40b86b4b684b4a638b50656189df8774, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.538873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.539650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.540058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.540375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.541823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.542994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.543882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.564209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1160/2294] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:15.564209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.571573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28bf43-4853-4254-b09b-bca99351c6e0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.577093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.578094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.579073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.579591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] PATH_INFO: `/v3/projects/339211eaa93346f9b28e87790df038ce/users/603cc234019144e99ca7fb74cc87a0ef/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.583555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339211eaa93346f9b28e87790df038ce, user_id=603cc234019144e99ca7fb74cc87a0ef, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.586562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.604673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1161/2295] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:15 2022] PUT /identity/v3/projects/339211eaa93346f9b28e87790df038ce/users/603cc234019144e99ca7fb74cc87a0ef/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:15.605936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.640017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1135/2296] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:15 2022] PUT /identity/v3/projects/030255e4b76046daabe53dc560444953/users/40b86b4b684b4a638b50656189df8774/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:15.641619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.738015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d464-ab59-456c-a90e-d033aa25305a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.741137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb94e8-b3a4-43bc-bb36-3047fb5b8154 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.744034 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.745373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.745594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.746127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.746963 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:15.747234 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.747710 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.748475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.748855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.749036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.749320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.750273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.752039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.763930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1136/2297] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:15.765314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.765909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1162/2298] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:15.767663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.783101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7adab-bd8f-4174-899c-8a63f4b51aec admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.783513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718a36b-20ac-4fff-991a-cbea324d6df2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.789528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.790356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.792991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.792991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] PATH_INFO: `/v3/projects/b10961f0f3f94bfca31eb9babc938375/users/f186314fbe0842a1b18277f49ea36043/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.794267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.796785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.797570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.798734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.800094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.803578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.826538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1163/2299] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:15.831793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:15.831793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10961f0f3f94bfca31eb9babc938375, user_id=f186314fbe0842a1b18277f49ea36043, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.831793 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.832443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.848992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb796-56ae-4a82-9d88-64b8a7fcf2cb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:15.856366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:15.862353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:15.862353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:15.862353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:15.862353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:15.862353 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:15.943066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1137/2300] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:15 2022] PUT /identity/v3/projects/b10961f0f3f94bfca31eb9babc938375/users/f186314fbe0842a1b18277f49ea36043/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:15.943452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:15.975741 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1164/2301] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:15 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:15.978513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:16.074978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0803c8-35bd-4be5-9918-3a9db82f7d32 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:16.086150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:16.086309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7a3f-f708-4916-8711-f438e34d3697 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:16.086413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.086413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.088421 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] PATH_INFO: `/v3/projects/2397ca5c13ea46389d420fb5445e125c/users/40cbdddcbcc345d49f24f3755cb2875f/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.090307 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbd16-9171-4e46-90d9-c06eec84d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:16.091059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbd16-9171-4e46-90d9-c06eec84d418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.091408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbd16-9171-4e46-90d9-c06eec84d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.091751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbd16-9171-4e46-90d9-c06eec84d418 admin admin] PATH_INFO: `/v3/projects/030255e4b76046daabe53dc560444953/users/40b86b4b684b4a638b50656189df8774/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.097023 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cbd16-9171-4e46-90d9-c06eec84d418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030255e4b76046daabe53dc560444953, user_id=40b86b4b684b4a638b50656189df8774, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:16.099917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cbd16-9171-4e46-90d9-c06eec84d418 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:16.127105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1165/2302] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:15 2022] PUT /identity/v3/projects/030255e4b76046daabe53dc560444953/users/40b86b4b684b4a638b50656189df8774/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:16.131878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.131878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.131878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.154846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2397ca5c13ea46389d420fb5445e125c, user_id=40cbdddcbcc345d49f24f3755cb2875f, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:16.154846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:16.190779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] MFA Rules not processed for user `f186314fbe0842a1b18277f49ea36043`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:16.192097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:16.252777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1138/2303] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:15 2022] PUT /identity/v3/projects/2397ca5c13ea46389d420fb5445e125c/users/40cbdddcbcc345d49f24f3755cb2875f/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:16.253824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:16.303651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1166/2304] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:16.304605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:16.306448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:16.348558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc181c9-ebc5-4f4a-ae8a-29e41702cb47 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:16.354045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71b5a4-5d91-46b0-a74c-ef1bb277043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:16.354673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b5a4-5d91-46b0-a74c-ef1bb277043f admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.354939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b5a4-5d91-46b0-a74c-ef1bb277043f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.355484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b5a4-5d91-46b0-a74c-ef1bb277043f admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.355890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71b5a4-5d91-46b0-a74c-ef1bb277043f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:16.370733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71b5a4-5d91-46b0-a74c-ef1bb277043f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:16.380769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a33b2-b83f-4f02-9a08-ea5e5d9422a0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:16.386100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:16.387123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.387246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.387476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] PATH_INFO: `/v3/users/a15e60f4b1504286ae54d14f4fea0c84` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.388956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15e60f4b1504286ae54d14f4fea0c84)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:16.392126 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:16.693995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1139/2305] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:16 2022] POST /identity/v3/users => generated 295 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:16.695976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9882-23d6-43b0-9c57-e557aa6ec508 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.695976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9882-23d6-43b0-9c57-e557aa6ec508 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.695976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9882-23d6-43b0-9c57-e557aa6ec508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.724611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-cf2c9882-23d6-43b0-9c57-e557aa6ec508 None None] MFA Rules not processed for user `40b86b4b684b4a638b50656189df8774`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:16.725356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cf2c9882-23d6-43b0-9c57-e557aa6ec508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:16.817239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1140/2306] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:16.817239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62201a-3024-495c-b00d-fdac625545a0 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.817239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62201a-3024-495c-b00d-fdac625545a0 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.817239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62201a-3024-495c-b00d-fdac625545a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.828344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15e60f4b1504286ae54d14f4fea0c84'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:16.830027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15e60f4b1504286ae54d14f4fea0c84'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:16.852389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15e60f4b1504286ae54d14f4fea0c84'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:16.863620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15e60f4b1504286ae54d14f4fea0c84'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:16.878438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9d62201a-3024-495c-b00d-fdac625545a0 None None] MFA Rules not processed for user `40cbdddcbcc345d49f24f3755cb2875f`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:16.880254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9d62201a-3024-495c-b00d-fdac625545a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:16.970007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1141/2307] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:16.970707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62201a-3024-495c-b00d-fdac625545a0 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:16.977503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15e60f4b1504286ae54d14f4fea0c84'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:16.985283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62201a-3024-495c-b00d-fdac625545a0 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:16.994984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:16.995991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:16.996450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:16.997045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:16.997949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.000846 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.003085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1167/2308] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:16 2022] DELETE /identity/v3/users/a15e60f4b1504286ae54d14f4fea0c84 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:17.004421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.006450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.090517 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb606d-9a56-417f-9833-3cf6bf6169f2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.098423 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:17.099064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.099400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.099805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.100318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.101997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.118122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1168/2309] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:17.120415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.122956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.141677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1142/2310] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:16 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:17.143174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.145491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.250198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb515d7f-6f7c-469f-b992-43ea5397dcc8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.256722 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638e75-72a2-4ebe-a2de-d0b4c9e0e950 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.259804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fc8ae-c6a8-47c0-ac78-7ffe4cdd287c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:17.260453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fc8ae-c6a8-47c0-ac78-7ffe4cdd287c service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.260739 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fc8ae-c6a8-47c0-ac78-7ffe4cdd287c service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.260855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:17.261032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fc8ae-c6a8-47c0-ac78-7ffe4cdd287c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.262938 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.263232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.263546 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.265849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.267116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-523fc8ae-c6a8-47c0-ac78-7ffe4cdd287c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.347503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fc8ae-c6a8-47c0-ac78-7ffe4cdd287c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.349019 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fc8ae-c6a8-47c0-ac78-7ffe4cdd287c service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.349977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.351974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.360867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1169/2311] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:17 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:17.362221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c52d6-9215-42da-b53b-db0e3d9cec27 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.362514 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c52d6-9215-42da-b53b-db0e3d9cec27 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.362802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c52d6-9215-42da-b53b-db0e3d9cec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.367903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1143/2312] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:17.369937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.420392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-614c52d6-9215-42da-b53b-db0e3d9cec27 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:17.425080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-614c52d6-9215-42da-b53b-db0e3d9cec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.485155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dd437-57e7-4727-8b97-34ec2d09bc47 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.495065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:17.497907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.498232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.498516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.501118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.506228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.523524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1144/2313] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:17.524476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.527736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.558586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f3f5f-600b-4058-8e97-e645e77ba09d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.568430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:17.569082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.569369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.569648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.570526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.572608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.609886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1170/2314] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:17.611032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c52d6-9215-42da-b53b-db0e3d9cec27 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.644974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c52d6-9215-42da-b53b-db0e3d9cec27 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.655913 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac0817-b4f0-48f9-99d1-5a45dafe3571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:17.656975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0817-b4f0-48f9-99d1-5a45dafe3571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.656975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0817-b4f0-48f9-99d1-5a45dafe3571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.657208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0817-b4f0-48f9-99d1-5a45dafe3571 admin admin] PATH_INFO: `/v3/projects/c99e012a902b4bed9a20122475c088d6/users/73372eb6282c4a998c90ab33381447e5/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.674711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1145/2315] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:17 2022] POST /identity/v3/users => generated 303 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:17.679937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.686446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.705911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac0817-b4f0-48f9-99d1-5a45dafe3571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99e012a902b4bed9a20122475c088d6, user_id=73372eb6282c4a998c90ab33381447e5, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.705911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac0817-b4f0-48f9-99d1-5a45dafe3571 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.806788 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a431ad-4006-46a2-8500-bb6f05ffd809 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.812643 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:17.813648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.814187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.814560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.830314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:17.835241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1171/2316] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:17 2022] PUT /identity/v3/projects/c99e012a902b4bed9a20122475c088d6/users/73372eb6282c4a998c90ab33381447e5/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:17.836753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c8dcf-80e5-4f41-8b08-fb3e41ff0901 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.837196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c8dcf-80e5-4f41-8b08-fb3e41ff0901 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.837574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c8dcf-80e5-4f41-8b08-fb3e41ff0901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:17.855549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:17.856926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:17.870899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1146/2317] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:17.871833 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:17.887457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e7830-468d-4741-a24c-d9607e6aa380 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:17.892943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8e6c8dcf-80e5-4f41-8b08-fb3e41ff0901 None None] MFA Rules not processed for user `603cc234019144e99ca7fb74cc87a0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:17.894579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8e6c8dcf-80e5-4f41-8b08-fb3e41ff0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:17.985298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1172/2318] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:17.986892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fe66a-db73-4793-a7d3-9de97a76d5a8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:17.987299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fe66a-db73-4793-a7d3-9de97a76d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:17.988015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fe66a-db73-4793-a7d3-9de97a76d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.055058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5c3fe66a-db73-4793-a7d3-9de97a76d5a8 None None] MFA Rules not processed for user `73372eb6282c4a998c90ab33381447e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:18.062583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5c3fe66a-db73-4793-a7d3-9de97a76d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:18.086838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212083b-3bc7-4456-b19f-2a469e249a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.090383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212083b-3bc7-4456-b19f-2a469e249a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.090383 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212083b-3bc7-4456-b19f-2a469e249a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.090819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212083b-3bc7-4456-b19f-2a469e249a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.092369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212083b-3bc7-4456-b19f-2a469e249a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.095008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212083b-3bc7-4456-b19f-2a469e249a8c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.110373 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1147/2319] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:18.130106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36bc0a-4351-4171-b388-3457cfbd3bdf None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.130106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36bc0a-4351-4171-b388-3457cfbd3bdf None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.130106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36bc0a-4351-4171-b388-3457cfbd3bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.157754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1e36bc0a-4351-4171-b388-3457cfbd3bdf None None] MFA Rules not processed for user `bdbec54572cd419db1a283a72ea5a1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:18.157754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1e36bc0a-4351-4171-b388-3457cfbd3bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:18.163427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1173/2320] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:18.164613 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fe66a-db73-4793-a7d3-9de97a76d5a8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:18.177887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fe66a-db73-4793-a7d3-9de97a76d5a8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:18.184159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.185092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.185548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.186257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] PATH_INFO: `/v3/projects/b4f33d12f26f445a915a3c2e7785ccf8/users/534cdbc1b874418bb49d88c65ee4e134/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.215174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f33d12f26f445a915a3c2e7785ccf8, user_id=534cdbc1b874418bb49d88c65ee4e134, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.219046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.254881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1148/2321] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:18.256120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36bc0a-4351-4171-b388-3457cfbd3bdf None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:18.327814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1174/2322] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:18 2022] PUT /identity/v3/projects/b4f33d12f26f445a915a3c2e7785ccf8/users/534cdbc1b874418bb49d88c65ee4e134/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:18.331680 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:18.341016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36bc0a-4351-4171-b388-3457cfbd3bdf None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:18.401979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.402449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.402733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.403005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.408206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:18.423375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750d5f9-3f69-4ff7-9408-dc4f54d99058 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:18.429404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.430238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.430643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.430933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.431684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.434089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.467308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:18.499754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.501491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.529211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1149/2323] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:18 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:18.529211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:18.529211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:18.624906 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1175/2324] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:18 2022] POST /identity/v3/projects => generated 389 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:18.627917 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:18.661420 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9a899-a318-49b8-b3fb-459a4a2560e0 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:18.770986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4958a1-2e05-4fc0-8a67-cced48dd2fcd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:18.777226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.777945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.778239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.778503 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.779194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.782414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.809894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.810679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.810895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.811183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.816341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1176/2325] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:18.816341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:18.817679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:18.818775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:18.849576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bca374-c37d-4a53-a75a-cf8b233ff325 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:18.856000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.857182 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.857484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.858029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] PATH_INFO: `/v3/projects/a28890dbf4a34181a76eb99f0e9570a6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.863317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28890dbf4a34181a76eb99f0e9570a6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.865652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.903466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.906016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.917069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1150/2326] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:18.917913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:18.930452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe7c1-64c5-4d50-bc88-306e1cd79cf6 service nova] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:18.935462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:18.936139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:18.936426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:18.936870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:18.937711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:18.940083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:18.958160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28890dbf4a34181a76eb99f0e9570a6', 'request_id': 'req-d81c7beb-e73b-4a9f-b35a-637b0924fc82'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:18.964120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28890dbf4a34181a76eb99f0e9570a6', 'request_id': 'req-d81c7beb-e73b-4a9f-b35a-637b0924fc82'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.022095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1151/2327] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:18 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:19.022095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.033640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31176-c7e4-4154-b7e8-ac2a985f936c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.034363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28890dbf4a34181a76eb99f0e9570a6', 'request_id': 'req-d81c7beb-e73b-4a9f-b35a-637b0924fc82'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.047961 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] The token cache is being invalidate because project a28890dbf4a34181a76eb99f0e9570a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:19.048250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.048938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.050657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1177/2328] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:18 2022] DELETE /identity/v3/projects/a28890dbf4a34181a76eb99f0e9570a6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:19.051638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.053020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:19.096765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.097587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.097913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.098320 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] PATH_INFO: `/v3/projects/b4f33d12f26f445a915a3c2e7785ccf8/users/534cdbc1b874418bb49d88c65ee4e134/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.100375 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f33d12f26f445a915a3c2e7785ccf8, user_id=534cdbc1b874418bb49d88c65ee4e134, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.103406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:19.115247 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1152/2329] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:19 2022] PUT /identity/v3/projects/b4f33d12f26f445a915a3c2e7785ccf8/users/534cdbc1b874418bb49d88c65ee4e134/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:19.116071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.120724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c7beb-e73b-4a9f-b35a-637b0924fc82 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.126985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:19.200858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed43ae-8797-4c6f-8e6b-fb870ccf9f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.201519 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed43ae-8797-4c6f-8e6b-fb870ccf9f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.201953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed43ae-8797-4c6f-8e6b-fb870ccf9f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.202761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed43ae-8797-4c6f-8e6b-fb870ccf9f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.203795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed43ae-8797-4c6f-8e6b-fb870ccf9f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.205607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed43ae-8797-4c6f-8e6b-fb870ccf9f19 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:19.217760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1178/2330] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:19.222915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c3c2-f381-4ced-9d49-238ddd17f9de None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.223212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c3c2-f381-4ced-9d49-238ddd17f9de None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.226851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c3c2-f381-4ced-9d49-238ddd17f9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.226970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d1cc7-817f-454c-8b79-0eefa0a90e90 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.230854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.231520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.232162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.232533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] PATH_INFO: `/v3/users/7191f5586375421e9e79a7f624540461` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.234411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7191f5586375421e9e79a7f624540461)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.237566 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:19.260706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2991c3c2-f381-4ced-9d49-238ddd17f9de None None] MFA Rules not processed for user `534cdbc1b874418bb49d88c65ee4e134`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:19.262587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2991c3c2-f381-4ced-9d49-238ddd17f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:19.281822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:19.348033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1179/2331] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:19.348921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991c3c2-f381-4ced-9d49-238ddd17f9de None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.360140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991c3c2-f381-4ced-9d49-238ddd17f9de None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.365568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.366336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.366624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.366907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] PATH_INFO: `/v3/projects/d5e48c6933da473198d1438fde9300ee/users/5875ec6d83cd4a58a1cbe1112ba31966/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.394301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e48c6933da473198d1438fde9300ee, user_id=5875ec6d83cd4a58a1cbe1112ba31966, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.398641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:19.459744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1180/2332] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:19 2022] PUT /identity/v3/projects/d5e48c6933da473198d1438fde9300ee/users/5875ec6d83cd4a58a1cbe1112ba31966/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:19.460966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.462869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:19.479950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7191f5586375421e9e79a7f624540461'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.482254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7191f5586375421e9e79a7f624540461'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.498644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7191f5586375421e9e79a7f624540461'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.520281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:19.541127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f5d01-93c0-427f-8df6-9648f95e7bb0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.545324 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.546996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.547651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.548037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.583736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7191f5586375421e9e79a7f624540461'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.584397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7191f5586375421e9e79a7f624540461'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:19.609197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1153/2333] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:19 2022] DELETE /identity/v3/users/7191f5586375421e9e79a7f624540461 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:19.611207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.613733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:19.648401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.651329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:19.681035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1181/2334] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:19.779453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.780681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c72-837d-405c-bda1-2158428cdf99 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.790612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.791703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.792173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.793098 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.794449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.795541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2873a3-1dfe-4a20-bc86-3ae5277b8749 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.799101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:19.824810 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1154/2335] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:19.830325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:19.844683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3519a-d992-4af0-8a4a-66bc1d0ebaf0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:19.852306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f9b73-0ec1-4790-b277-fcf9c8414c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.852306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9b73-0ec1-4790-b277-fcf9c8414c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.852306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9b73-0ec1-4790-b277-fcf9c8414c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.852306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9b73-0ec1-4790-b277-fcf9c8414c10 admin admin] PATH_INFO: `/v3/projects/d5e48c6933da473198d1438fde9300ee/users/5875ec6d83cd4a58a1cbe1112ba31966/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.854065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f9b73-0ec1-4790-b277-fcf9c8414c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e48c6933da473198d1438fde9300ee, user_id=5875ec6d83cd4a58a1cbe1112ba31966, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.857191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f9b73-0ec1-4790-b277-fcf9c8414c10 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:19.871283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1155/2336] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:19 2022] PUT /identity/v3/projects/d5e48c6933da473198d1438fde9300ee/users/5875ec6d83cd4a58a1cbe1112ba31966/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:19.881910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.882323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.882672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.907619 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:19.908249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:19.908560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:19.908841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:19.910702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:19.912889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] MFA Rules not processed for user `5875ec6d83cd4a58a1cbe1112ba31966`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:19.914129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:19.993059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:19.995097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:20.010859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1182/2337] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:20.011394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1156/2338] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:20.180252 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:20.181846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:20.197201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12959c-6044-476f-8740-7123d8ae18f3 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:20.277841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:20.278659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:20.279005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:20.279356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] PATH_INFO: `/v3/projects/2dea349d5530485682459d70b4d0a5fd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:20.281401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dea349d5530485682459d70b4d0a5fd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:20.283583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:20.303587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:20.319728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:20.321171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:20.396740 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cffbd-8d27-4ca2-a15e-fa5021a4924f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:20.410778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e08619-8d5f-4a32-b0c3-e1efad201e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:20.411434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e08619-8d5f-4a32-b0c3-e1efad201e4f service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:20.411721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e08619-8d5f-4a32-b0c3-e1efad201e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:20.411998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e08619-8d5f-4a32-b0c3-e1efad201e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:20.423834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e08619-8d5f-4a32-b0c3-e1efad201e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:20.425647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e08619-8d5f-4a32-b0c3-e1efad201e4f service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:20.436783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1157/2339] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:20.485900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dea349d5530485682459d70b4d0a5fd', 'request_id': 'req-195a5da6-8cff-4d75-ae53-a9cadd9c44be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:20.494148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dea349d5530485682459d70b4d0a5fd', 'request_id': 'req-195a5da6-8cff-4d75-ae53-a9cadd9c44be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:20.623195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dea349d5530485682459d70b4d0a5fd', 'request_id': 'req-195a5da6-8cff-4d75-ae53-a9cadd9c44be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:20.639293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] The token cache is being invalidate because project 2dea349d5530485682459d70b4d0a5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:20.640199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:20.640717 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-195a5da6-8cff-4d75-ae53-a9cadd9c44be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:20.642938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1183/2340] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:20 2022] DELETE /identity/v3/projects/2dea349d5530485682459d70b4d0a5fd => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:20.647838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a66b-e865-4661-aedf-a64794b899ef None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:20.648127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a66b-e865-4661-aedf-a64794b899ef None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:20.648460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a66b-e865-4661-aedf-a64794b899ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:20.673096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1369a66b-e865-4661-aedf-a64794b899ef None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:20.675914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1369a66b-e865-4661-aedf-a64794b899ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:20.751622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1158/2341] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:20.760850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868126f0-5f33-4357-a0a0-5d750320c053 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:20.761301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868126f0-5f33-4357-a0a0-5d750320c053 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:20.761816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868126f0-5f33-4357-a0a0-5d750320c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:20.793073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-868126f0-5f33-4357-a0a0-5d750320c053 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:20.795232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-868126f0-5f33-4357-a0a0-5d750320c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:20.810365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1184/2342] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:20.815842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369a66b-e865-4661-aedf-a64794b899ef None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:20.826920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369a66b-e865-4661-aedf-a64794b899ef None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:20.832407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:20.832893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:20.833220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:20.833578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:20.834287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:20.834767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:20.838910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:20.896809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1159/2343] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:24:20.898041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868126f0-5f33-4357-a0a0-5d750320c053 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:20.922570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868126f0-5f33-4357-a0a0-5d750320c053 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:20.931825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:20.934194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:20.934899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:20.935738 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:20.937607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:20.941507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:21.074718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1185/2344] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:20 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:21.078482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:21.097488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57dd82-f8bf-4a72-811a-891c86ee025f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:21.143405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:21.152747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:21.155226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:21.274757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:21.274757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:21.274757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:21.274757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:21.275815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:21.275815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:21.314531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06879a-6784-4329-b82f-9ac9efe7384d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:21.321254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:21.322064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:21.322428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:21.322770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] PATH_INFO: `/v3/users/73372eb6282c4a998c90ab33381447e5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:21.324120 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73372eb6282c4a998c90ab33381447e5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:21.326269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:21.759324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1160/2345] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:21 2022] POST /identity/v3/users => generated 289 bytes in 679 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:21.760544 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:21.771015 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d1957-b0c0-442a-9695-300a68b03c26 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:21.775915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:21.776465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:21.776794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:21.777181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:21.777929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:21.779605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:21.793303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1161/2346] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:21.802691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:21.813246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ab4e7-b979-45ee-88a2-ea800d511d87 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:21.818117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:21.818706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:21.819002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:21.819343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:21.819957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:21.821625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:21.832025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1162/2347] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:21.836182 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:21.847230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1f8e-f3a7-495b-ac4b-57a4223512d8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:21.853434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aacc4-a91f-4542-8f3b-d8a0e0bf9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:21.854257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aacc4-a91f-4542-8f3b-d8a0e0bf9d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:21.854682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aacc4-a91f-4542-8f3b-d8a0e0bf9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:21.854971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aacc4-a91f-4542-8f3b-d8a0e0bf9d4b admin admin] PATH_INFO: `/v3/projects/0856392e6db1424c98332f02fb065baa/users/b7f95bc23b9e4588a4b708bebd104be9/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:21.857689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73372eb6282c4a998c90ab33381447e5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:21.860706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73372eb6282c4a998c90ab33381447e5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:21.880496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73372eb6282c4a998c90ab33381447e5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:21.886062 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aacc4-a91f-4542-8f3b-d8a0e0bf9d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0856392e6db1424c98332f02fb065baa, user_id=b7f95bc23b9e4588a4b708bebd104be9, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:21.888776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73372eb6282c4a998c90ab33381447e5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:21.888978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aacc4-a91f-4542-8f3b-d8a0e0bf9d4b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:21.954966 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-48682a49-5f6a-4549-93a2-bfa5e1e65683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73372eb6282c4a998c90ab33381447e5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:21.961457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1163/2348] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:21 2022] PUT /identity/v3/projects/0856392e6db1424c98332f02fb065baa/users/b7f95bc23b9e4588a4b708bebd104be9/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:21.963469 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1186/2349] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:21 2022] DELETE /identity/v3/users/73372eb6282c4a998c90ab33381447e5 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:21.970212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:21.970508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:21.970791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:21.973151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:21.973992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:21.973992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.002486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:22.003758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:22.006249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] MFA Rules not processed for user `b7f95bc23b9e4588a4b708bebd104be9`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:22.009786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:22.134980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1164/2350] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:22.143269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.146741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:22.148388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1187/2351] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:22.157025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.158830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:22.179730 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d275-d031-4c41-84b9-7293450b20b1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.189351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.190625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.190860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.191161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.191919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:22.194042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:22.229357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064933b-8527-4b06-866d-84ada3fcbf97 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.234419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.237342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.237342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.237342 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.246174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:22.247858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:22.260536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1165/2352] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:22.300008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:22.307967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1188/2353] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:22 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:22.313562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.325801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9f4e-cf44-42ae-a28b-ee388b4ebadc service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.393155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.394035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.397632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.397632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.397632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:22.397632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:22.501763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1166/2354] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:22 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:22.504153 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.516682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108c64-cd84-45b7-8aac-8015648c52b3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.522773 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.523544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.523872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.524164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.524946 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:22.526862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:22.549397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1189/2355] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:22.551687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.578116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc134cfe-ec8d-4336-972a-d10ec8392c6a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.584855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.585801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.586300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.586651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] PATH_INFO: `/v3/projects/f7afe1cae1fb4bfd9cd4cb5cc2e668c3/users/e5f97d7262a24a908c921a1c60084626/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.608249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7afe1cae1fb4bfd9cd4cb5cc2e668c3, user_id=e5f97d7262a24a908c921a1c60084626, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:22.611601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:22.690897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1167/2356] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:22 2022] PUT /identity/v3/projects/f7afe1cae1fb4bfd9cd4cb5cc2e668c3/users/e5f97d7262a24a908c921a1c60084626/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:22.694781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.710723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78937-709e-4603-93f6-8c6a6fbc3347 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.784509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.785128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.785575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.785835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.786532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:22.788140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:22.794921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:22.800020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1190/2357] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:22.804091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.817550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aefdb0-3fb8-4155-b614-e0a3514d2ac2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.823066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334e718-c841-45d5-9b33-def42b5f41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.824092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e718-c841-45d5-9b33-def42b5f41da admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.824402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e718-c841-45d5-9b33-def42b5f41da admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.824731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e718-c841-45d5-9b33-def42b5f41da admin admin] PATH_INFO: `/v3/projects/f7afe1cae1fb4bfd9cd4cb5cc2e668c3/users/e5f97d7262a24a908c921a1c60084626/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.827669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334e718-c841-45d5-9b33-def42b5f41da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7afe1cae1fb4bfd9cd4cb5cc2e668c3, user_id=e5f97d7262a24a908c921a1c60084626, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:22.832219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334e718-c841-45d5-9b33-def42b5f41da admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:22.846610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:22.848905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:22.851255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1168/2358] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:22 2022] PUT /identity/v3/projects/f7afe1cae1fb4bfd9cd4cb5cc2e668c3/users/e5f97d7262a24a908c921a1c60084626/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:22.864513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.865263 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.865997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:22.904609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf634f-058e-491a-ada4-0f320744b261 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:22.925628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] MFA Rules not processed for user `e5f97d7262a24a908c921a1c60084626`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:22.928131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:22.998066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:22.998729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:22.999022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:22.999301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] PATH_INFO: `/v3/projects/c99e012a902b4bed9a20122475c088d6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:23.001672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99e012a902b4bed9a20122475c088d6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:23.003944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:23.034502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1169/2359] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:23.042125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:23.043657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:23.151162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99e012a902b4bed9a20122475c088d6', 'request_id': 'req-872829f6-751a-4f32-8e52-60fce7100265'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.163720 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99e012a902b4bed9a20122475c088d6', 'request_id': 'req-872829f6-751a-4f32-8e52-60fce7100265'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.174912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0d1d-60d7-4d1c-909c-980f586cd117 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:23.259826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:23.260843 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:23.261442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:23.261970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:23.290155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99e012a902b4bed9a20122475c088d6', 'request_id': 'req-872829f6-751a-4f32-8e52-60fce7100265'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.305682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] The token cache is being invalidate because project c99e012a902b4bed9a20122475c088d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:23.306653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.310489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.313082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1191/2360] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:22 2022] DELETE /identity/v3/projects/c99e012a902b4bed9a20122475c088d6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:23.316968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:23.318461 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:23.338663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:23.340335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:23.351004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1170/2361] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:23.427497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872829f6-751a-4f32-8e52-60fce7100265 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:23.432831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:23.433823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:23.434181 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:23.434489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] PATH_INFO: `/v3/users/5875ec6d83cd4a58a1cbe1112ba31966` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:23.435891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5875ec6d83cd4a58a1cbe1112ba31966)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:23.438077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:23.607314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5875ec6d83cd4a58a1cbe1112ba31966'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.608130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5875ec6d83cd4a58a1cbe1112ba31966'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.622863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5875ec6d83cd4a58a1cbe1112ba31966'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.632402 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5875ec6d83cd4a58a1cbe1112ba31966'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.657410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:23.708828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a9fc63ea-752a-408e-88f3-c6516406cf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5875ec6d83cd4a58a1cbe1112ba31966'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:23.716205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1192/2362] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:23 2022] DELETE /identity/v3/users/5875ec6d83cd4a58a1cbe1112ba31966 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:23.914087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:24.304998 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:24.333743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82956-f0de-4a86-848f-e61aa4b8567e service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:24.430479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:24.431483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:24.431924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:24.432344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] PATH_INFO: `/v3/projects/d5e48c6933da473198d1438fde9300ee` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:24.437338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e48c6933da473198d1438fde9300ee)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:24.443222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:24.536725 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:24.584497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e48c6933da473198d1438fde9300ee', 'request_id': 'req-8b438e41-f8e9-43e7-8671-72fa4db619fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:24.590888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e48c6933da473198d1438fde9300ee', 'request_id': 'req-8b438e41-f8e9-43e7-8671-72fa4db619fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:24.597350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e48c6933da473198d1438fde9300ee', 'request_id': 'req-8b438e41-f8e9-43e7-8671-72fa4db619fd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:24.712179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] The token cache is being invalidate because project d5e48c6933da473198d1438fde9300ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:24.712179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:24.716317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8b438e41-f8e9-43e7-8671-72fa4db619fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:24.720162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1171/2363] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:24 2022] DELETE /identity/v3/projects/d5e48c6933da473198d1438fde9300ee => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:24.726265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f854-0ed0-4334-92ac-5f8b0ab145db None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:24.730538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f854-0ed0-4334-92ac-5f8b0ab145db None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:24.731211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f854-0ed0-4334-92ac-5f8b0ab145db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:24.784011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-99b2f854-0ed0-4334-92ac-5f8b0ab145db None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:24.786843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-99b2f854-0ed0-4334-92ac-5f8b0ab145db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:24.804352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:24.879502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1193/2364] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:24.888133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86719-8d80-4d5b-a031-d91cb7829734 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:24.888589 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86719-8d80-4d5b-a031-d91cb7829734 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:24.888867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86719-8d80-4d5b-a031-d91cb7829734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:24.910343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f5c86719-8d80-4d5b-a031-d91cb7829734 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:24.911521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f5c86719-8d80-4d5b-a031-d91cb7829734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:24.919328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1172/2365] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:24.924192 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f854-0ed0-4334-92ac-5f8b0ab145db None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:24.934693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f854-0ed0-4334-92ac-5f8b0ab145db None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:24.940889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:24.941755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:24.942110 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:24.942497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:24.943266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:24.943658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:24.945381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:24.961646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1194/2366] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:24.966426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86719-8d80-4d5b-a031-d91cb7829734 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:24.976907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86719-8d80-4d5b-a031-d91cb7829734 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:24.983201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:24.984707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:24.985239 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:24.985786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:24.986806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:24.991053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:25.126648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1173/2367] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:24 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:25.127951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:25.142256 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4fa39-3c36-4929-8fce-7a50ee5719ef admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:25.145753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:25.228611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:25.230088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:25.230088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:25.230088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:25.230786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:25.232887 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:25.358824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1195/2368] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:25 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:25.359812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:25.382816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82deb-afdf-4786-9949-df2e94f89015 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:25.388030 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:25.388575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:25.388859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:25.389135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:25.389946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:25.392525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:25.408477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1174/2369] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:25.409328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:25.419729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207aa9b-82cb-438e-af3b-56b7cb86e216 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:25.435327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfddcd-64bb-4287-bfae-c4a57d1f957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:25.438196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfddcd-64bb-4287-bfae-c4a57d1f957f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:25.438196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfddcd-64bb-4287-bfae-c4a57d1f957f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:25.438196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfddcd-64bb-4287-bfae-c4a57d1f957f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:25.438491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfddcd-64bb-4287-bfae-c4a57d1f957f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:25.440206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfddcd-64bb-4287-bfae-c4a57d1f957f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:25.459318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1196/2370] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:25.461169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:25.489212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1218-22e9-4c1c-a697-02d8c345e8d9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:25.491548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:25.492289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:25.492577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:25.492876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] PATH_INFO: `/v3/projects/2d0a8d46f4fb488da62690ac00dcbccd/users/d96077811c6f453b892657665731295b/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:25.521972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0a8d46f4fb488da62690ac00dcbccd, user_id=d96077811c6f453b892657665731295b, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:25.521972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:25.639115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1175/2371] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:25 2022] PUT /identity/v3/projects/2d0a8d46f4fb488da62690ac00dcbccd/users/d96077811c6f453b892657665731295b/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:25.652135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:25.652309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb1213-f207-4a97-8cff-c58a3e66c3a4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:25.652763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb1213-f207-4a97-8cff-c58a3e66c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:25.652937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb1213-f207-4a97-8cff-c58a3e66c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:25.692883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bafb1213-f207-4a97-8cff-c58a3e66c3a4 None None] MFA Rules not processed for user `d96077811c6f453b892657665731295b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:25.694318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bafb1213-f207-4a97-8cff-c58a3e66c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:25.737980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:25.811578 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1197/2372] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:25.823052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:25.918065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63502a3-84be-406f-93ef-ad469f3c1d2a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:25.937890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:25.939265 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:25.939720 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:25.956919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:25.956919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:25.956919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:26.061831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1176/2373] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:25 2022] POST /identity/v3/projects => generated 381 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:26.066783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb1213-f207-4a97-8cff-c58a3e66c3a4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:26.090006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb1213-f207-4a97-8cff-c58a3e66c3a4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:26.180550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:26.181448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:26.181862 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:26.182163 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:26.182905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:26.186780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:26.206229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:26.248159 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1198/2374] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:26 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:26.255809 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:26.267524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23eee0-515d-4182-88a0-ba36b53e121c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:26.269303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:26.273982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:26.280442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:26.280442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:26.280442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:26.280442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:26.280442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:26.289288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1177/2375] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:26.293980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:26.305792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490dc17-5325-40b0-a620-0d4512e9f11d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:26.311054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:26.311722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:26.312512 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:26.312885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] PATH_INFO: `/v3/projects/906cd51677c143cbb0b8b63e85a58e0a/users/a29fff5146f949bf8d523ee8aa457b15/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:26.331534 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906cd51677c143cbb0b8b63e85a58e0a, user_id=a29fff5146f949bf8d523ee8aa457b15, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:26.334379 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:26.464249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1199/2376] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:26 2022] PUT /identity/v3/projects/906cd51677c143cbb0b8b63e85a58e0a/users/a29fff5146f949bf8d523ee8aa457b15/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:26.469471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:26.482770 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90032e4b-e43c-4b46-a09e-a621b84cf3d3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:26.555364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693980c5-fe34-4513-9d0d-f14eb0420b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:26.556077 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693980c5-fe34-4513-9d0d-f14eb0420b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:26.556592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693980c5-fe34-4513-9d0d-f14eb0420b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:26.557076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693980c5-fe34-4513-9d0d-f14eb0420b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:26.558146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693980c5-fe34-4513-9d0d-f14eb0420b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:26.559859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693980c5-fe34-4513-9d0d-f14eb0420b9c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:26.571281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1178/2377] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:26.575729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:26.586599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419438ec-ec61-440a-9569-e096f914adc0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:26.593270 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:26.594263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:26.594771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:26.595175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] PATH_INFO: `/v3/projects/906cd51677c143cbb0b8b63e85a58e0a/users/a29fff5146f949bf8d523ee8aa457b15/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:26.597383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] RBAC: Authorizing `identity:create_grant(project_id=906cd51677c143cbb0b8b63e85a58e0a, user_id=a29fff5146f949bf8d523ee8aa457b15, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:26.600222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:26.611675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1200/2378] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:26 2022] PUT /identity/v3/projects/906cd51677c143cbb0b8b63e85a58e0a/users/a29fff5146f949bf8d523ee8aa457b15/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:26.622357 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c18f-6b6d-41a2-b85d-22340a4063df None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:26.622689 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c18f-6b6d-41a2-b85d-22340a4063df None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:26.622932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c18f-6b6d-41a2-b85d-22340a4063df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:26.653593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b189c18f-6b6d-41a2-b85d-22340a4063df None None] MFA Rules not processed for user `a29fff5146f949bf8d523ee8aa457b15`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:26.654939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b189c18f-6b6d-41a2-b85d-22340a4063df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:26.734537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:26.734537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1179/2379] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:26.742953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:26.745003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:26.810278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfee9d-bc93-489e-b447-6270ac27642b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:26.814916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:26.815530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:26.815815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:26.816123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:26.827292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:26.829851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:26.842070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1201/2380] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:26.919950 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:27.074885 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189c18f-6b6d-41a2-b85d-22340a4063df None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:27.111959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189c18f-6b6d-41a2-b85d-22340a4063df None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:27.125132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36016a70-ff15-4da4-9fc9-675e52ff8959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:27.125900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36016a70-ff15-4da4-9fc9-675e52ff8959 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:27.126621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36016a70-ff15-4da4-9fc9-675e52ff8959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:27.126892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36016a70-ff15-4da4-9fc9-675e52ff8959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:27.155267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-36016a70-ff15-4da4-9fc9-675e52ff8959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:27.249950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36016a70-ff15-4da4-9fc9-675e52ff8959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:27.251176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36016a70-ff15-4da4-9fc9-675e52ff8959 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:27.265657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1180/2381] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:27.417395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:27.508850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:27.523707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:27.529960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:27.629018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64295018-9cd8-466f-9b11-d0d9a8659019 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:27.635588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:27.637673 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:27.640923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:27.640923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] PATH_INFO: `/v3/users/f186314fbe0842a1b18277f49ea36043` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:27.640923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f186314fbe0842a1b18277f49ea36043)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:27.643585 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:27.908830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f186314fbe0842a1b18277f49ea36043'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:27.910794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f186314fbe0842a1b18277f49ea36043'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:27.931187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f186314fbe0842a1b18277f49ea36043'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:27.945032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f186314fbe0842a1b18277f49ea36043'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:27.989091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:28.046037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f186314fbe0842a1b18277f49ea36043'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:28.054927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1202/2382] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:27 2022] DELETE /identity/v3/users/f186314fbe0842a1b18277f49ea36043 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:28.059686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:28.059686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:28.059923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:28.061400 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:28.081060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:28.082442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:28.147854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1181/2383] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:28.158627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:28.160226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:28.228199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602c35c-3502-498b-bba7-3115fea77f0b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:28.232180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:28.232980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:28.233417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:28.233764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:28.243618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:28.245300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:28.258580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1203/2384] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:28.443013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:28.444909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:28.465144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14441dd2-d6a8-4d77-8da6-efe9a1fe6e76 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:28.471946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:28.473543 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:28.474143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:28.475191 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] PATH_INFO: `/v3/users/436ff060cb774f15913142a8f14b6c6f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:28.477738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436ff060cb774f15913142a8f14b6c6f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:28.479805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:28.684159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436ff060cb774f15913142a8f14b6c6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:28.685405 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436ff060cb774f15913142a8f14b6c6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:28.706343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436ff060cb774f15913142a8f14b6c6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:28.726327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:28.728488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:28.748595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17b0b-6782-4fbc-bf2d-6859f94bb0bb service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:28.756059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:28.756823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:28.757114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:28.757397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] PATH_INFO: `/v3/users/d96077811c6f453b892657665731295b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:28.758824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96077811c6f453b892657665731295b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:28.763281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:28.813755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436ff060cb774f15913142a8f14b6c6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:28.820892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-79258984-c249-4603-a2e6-109f09984c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436ff060cb774f15913142a8f14b6c6f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:28.831880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1182/2385] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:28 2022] DELETE /identity/v3/users/436ff060cb774f15913142a8f14b6c6f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:28.837143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:28.837541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:28.837916 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:28.865461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:28.867419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:28.904254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:28.944198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1183/2386] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:28.947736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:28.947736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:28.959816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f08ce6-7bb4-4d41-93fc-240179251e6a None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:28.964927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:28.965635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:28.966014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:28.966355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] PATH_INFO: `/v3/projects/b10961f0f3f94bfca31eb9babc938375` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:28.967578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10961f0f3f94bfca31eb9babc938375)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:28.970321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:28.999021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96077811c6f453b892657665731295b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.008060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96077811c6f453b892657665731295b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.036959 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96077811c6f453b892657665731295b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.043172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96077811c6f453b892657665731295b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.103061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10961f0f3f94bfca31eb9babc938375', 'request_id': 'req-33e96518-ae67-447d-9104-756aefbc3a60'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.110196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10961f0f3f94bfca31eb9babc938375', 'request_id': 'req-33e96518-ae67-447d-9104-756aefbc3a60'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.115429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:29.117065 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96077811c6f453b892657665731295b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.117195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10961f0f3f94bfca31eb9babc938375', 'request_id': 'req-33e96518-ae67-447d-9104-756aefbc3a60'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.124356 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1204/2387] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:28 2022] DELETE /identity/v3/users/d96077811c6f453b892657665731295b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:29.126434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:29.129142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:29.189616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7c4ba-0b8e-470a-9ace-74b4f6d82bb7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:29.193639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:29.194425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:29.194723 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:29.195085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:29.197124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:29.216883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] The token cache is being invalidate because project b10961f0f3f94bfca31eb9babc938375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:29.217300 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.218777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-33e96518-ae67-447d-9104-756aefbc3a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.220661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1184/2388] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:28 2022] DELETE /identity/v3/projects/b10961f0f3f94bfca31eb9babc938375 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:29.222293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:29.223242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:29.223972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:29.247742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:29.249031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:29.285932 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:29.288530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:29.307380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1205/2389] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:29.309394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:29.311669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:29.326233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1185/2390] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:29.336312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542bd7-d05d-486b-beba-ca218a6a8887 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:29.340781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:29.344454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:29.345512 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:29.346357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:29.346752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:29.347106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] PATH_INFO: `/v3/users/534cdbc1b874418bb49d88c65ee4e134` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:29.349104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=534cdbc1b874418bb49d88c65ee4e134)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:29.351302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:29.364891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9505fbf-86f9-4a89-83ae-3cd954273765 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:29.370202 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:29.371152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:29.371634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:29.372169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:29.385749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:29.388969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:29.415932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1186/2391] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:29.640709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534cdbc1b874418bb49d88c65ee4e134'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.641858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534cdbc1b874418bb49d88c65ee4e134'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.660615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534cdbc1b874418bb49d88c65ee4e134'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.670020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:29.673586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534cdbc1b874418bb49d88c65ee4e134'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.760309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534cdbc1b874418bb49d88c65ee4e134'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:29.777839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1206/2392] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:29 2022] DELETE /identity/v3/users/534cdbc1b874418bb49d88c65ee4e134 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:29.846587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:29.996753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:29.998698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:30.013817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63410d-ca8a-4500-b3c7-727d23870b51 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:30.036595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:30.038284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:30.135791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:30.136948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:30.137559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:30.138289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] PATH_INFO: `/v3/projects/52dbe426b2c9419f8ecf31717c1c0941` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:30.140928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=52dbe426b2c9419f8ecf31717c1c0941)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:30.143310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:30.196454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7644-012b-4f54-ab2a-b443b46c4a6c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:30.202103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:30.203699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:30.204608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:30.204904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] PATH_INFO: `/v3/projects/2d0a8d46f4fb488da62690ac00dcbccd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:30.206222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0a8d46f4fb488da62690ac00dcbccd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:30.208366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:30.315154 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dbe426b2c9419f8ecf31717c1c0941', 'request_id': 'req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.331150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dbe426b2c9419f8ecf31717c1c0941', 'request_id': 'req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.341155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dbe426b2c9419f8ecf31717c1c0941', 'request_id': 'req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.342758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0a8d46f4fb488da62690ac00dcbccd', 'request_id': 'req-eb9704ca-c6fc-445b-b219-61135e8b188b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.362135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0a8d46f4fb488da62690ac00dcbccd', 'request_id': 'req-eb9704ca-c6fc-445b-b219-61135e8b188b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.441917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] The token cache is being invalidate because project 52dbe426b2c9419f8ecf31717c1c0941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:30.442222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.444285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.446273 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1187/2393] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:29 2022] DELETE /identity/v3/projects/52dbe426b2c9419f8ecf31717c1c0941 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:30.447045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:30.448500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:30.542858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17bd4d-13de-48ec-abd1-49e6cd6d41ad admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:30.565650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0a8d46f4fb488da62690ac00dcbccd', 'request_id': 'req-eb9704ca-c6fc-445b-b219-61135e8b188b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.580413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] The token cache is being invalidate because project 2d0a8d46f4fb488da62690ac00dcbccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:30.580853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.581660 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.583586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1207/2394] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:30 2022] DELETE /identity/v3/projects/2d0a8d46f4fb488da62690ac00dcbccd => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:30.584647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:30.586762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:30.614956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:30.615617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:30.615904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:30.616185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] PATH_INFO: `/v3/projects/b4f33d12f26f445a915a3c2e7785ccf8` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:30.617368 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f33d12f26f445a915a3c2e7785ccf8)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:30.619785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:30.665149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9704ca-c6fc-445b-b219-61135e8b188b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:30.670039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:30.670700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:30.670992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:30.671328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] PATH_INFO: `/v3/users/40b86b4b684b4a638b50656189df8774` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:30.672809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b86b4b684b4a638b50656189df8774)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:30.674834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:30.754712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:30.760937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f33d12f26f445a915a3c2e7785ccf8', 'request_id': 'req-e38a3156-d0ab-4079-8dd5-464663a0cf39'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.770290 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f33d12f26f445a915a3c2e7785ccf8', 'request_id': 'req-e38a3156-d0ab-4079-8dd5-464663a0cf39'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.776557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f33d12f26f445a915a3c2e7785ccf8', 'request_id': 'req-e38a3156-d0ab-4079-8dd5-464663a0cf39'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.880229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] The token cache is being invalidate because project b4f33d12f26f445a915a3c2e7785ccf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:30.882682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.882682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.883548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1188/2395] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:30 2022] DELETE /identity/v3/projects/b4f33d12f26f445a915a3c2e7785ccf8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:30.884755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:30.886333 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:30.901040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b86b4b684b4a638b50656189df8774'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.904765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b86b4b684b4a638b50656189df8774'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.925592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b86b4b684b4a638b50656189df8774'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.933089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:30.935988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b86b4b684b4a638b50656189df8774'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:30.972362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a3156-d0ab-4079-8dd5-464663a0cf39 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:30.977505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:30.980417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:30.980417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:30.980417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] PATH_INFO: `/v3/users/a29fff5146f949bf8d523ee8aa457b15` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:30.980417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29fff5146f949bf8d523ee8aa457b15)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:30.982698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:31.034398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c308503e-a306-44ca-9cf3-5acb81acfa14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b86b4b684b4a638b50656189df8774'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:31.041631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1208/2396] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:30 2022] DELETE /identity/v3/users/40b86b4b684b4a638b50656189df8774 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:31.043038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7b95f-b704-4726-bd67-33c3c57b50a7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:31.043327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7b95f-b704-4726-bd67-33c3c57b50a7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:31.043610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7b95f-b704-4726-bd67-33c3c57b50a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:31.072478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-68c7b95f-b704-4726-bd67-33c3c57b50a7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:31.074306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-68c7b95f-b704-4726-bd67-33c3c57b50a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:31.185024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1209/2397] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:31.195100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9049af-8498-4611-8863-7d7a1bdd68b8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:31.195385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9049af-8498-4611-8863-7d7a1bdd68b8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:31.195769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9049af-8498-4611-8863-7d7a1bdd68b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:31.224225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29fff5146f949bf8d523ee8aa457b15'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:31.225244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29fff5146f949bf8d523ee8aa457b15'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:31.230836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4e9049af-8498-4611-8863-7d7a1bdd68b8 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:31.233360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4e9049af-8498-4611-8863-7d7a1bdd68b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:31.256827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1210/2398] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:31.259913 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29fff5146f949bf8d523ee8aa457b15'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:31.261110 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9049af-8498-4611-8863-7d7a1bdd68b8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:31.280021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9049af-8498-4611-8863-7d7a1bdd68b8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:31.294235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:31.294900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:31.295188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:31.295474 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:31.296217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:31.296579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:31.301042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:31.328342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1211/2399] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:31.331747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:31.347484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e3172-7713-44e7-b26d-8bb435edbf56 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:31.353632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:31.354304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:31.354875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:31.354875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:31.355622 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:31.357629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:31.361173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29fff5146f949bf8d523ee8aa457b15'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:31.362267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29fff5146f949bf8d523ee8aa457b15'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:31.386510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1189/2400] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:30 2022] DELETE /identity/v3/users/a29fff5146f949bf8d523ee8aa457b15 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:31.457096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1212/2401] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:31 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:31.459839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:31.462597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:31.503048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:31.567945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:31.569815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:31.638045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cda11-fdc1-44f4-836b-729326217fe2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:31.754028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:31.755034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b953bb-d79d-4960-b3e4-f613b05ef351 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:31.756621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:31.757014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:31.757314 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:31.758686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:31.761208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:31.761432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:31.761851 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:31.761978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:31.762135 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] PATH_INFO: `/v3/users/40cbdddcbcc345d49f24f3755cb2875f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:31.763394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cbdddcbcc345d49f24f3755cb2875f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:31.766271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:31.822862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:31.891486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1190/2402] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:31 2022] POST /identity/v3/users => generated 292 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:31.893960 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:31.896118 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:31.910372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ccf8-03c4-4622-8528-9deebdf9d53c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:31.915335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:31.916000 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:31.916287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:31.916749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] PATH_INFO: `/v3/projects/030255e4b76046daabe53dc560444953` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:31.917787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=030255e4b76046daabe53dc560444953)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:31.919925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:31.994247 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cbdddcbcc345d49f24f3755cb2875f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:31.996859 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cbdddcbcc345d49f24f3755cb2875f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.018794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cbdddcbcc345d49f24f3755cb2875f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.027088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cbdddcbcc345d49f24f3755cb2875f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.031388 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030255e4b76046daabe53dc560444953', 'request_id': 'req-44957854-2167-4eee-9888-00bc781c88aa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.042818 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030255e4b76046daabe53dc560444953', 'request_id': 'req-44957854-2167-4eee-9888-00bc781c88aa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.055422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030255e4b76046daabe53dc560444953', 'request_id': 'req-44957854-2167-4eee-9888-00bc781c88aa'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.450929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cbdddcbcc345d49f24f3755cb2875f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.457372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1213/2403] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:31 2022] DELETE /identity/v3/users/40cbdddcbcc345d49f24f3755cb2875f => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:32.458202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:32.461349 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:32.526524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4942026-1cf3-41fe-941e-5a2fb9d9b25f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:32.531857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2a414-4e86-41eb-968b-da229a67192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:32.532478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2a414-4e86-41eb-968b-da229a67192c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:32.532764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2a414-4e86-41eb-968b-da229a67192c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:32.533041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2a414-4e86-41eb-968b-da229a67192c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:32.533767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2a414-4e86-41eb-968b-da229a67192c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:32.535394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2a414-4e86-41eb-968b-da229a67192c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:32.545615 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1214/2404] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:32.547455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cad9-090d-462b-bbb9-91e4d88dda82 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:32.547746 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cad9-090d-462b-bbb9-91e4d88dda82 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:32.548025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cad9-090d-462b-bbb9-91e4d88dda82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:32.566288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5589cad9-090d-462b-bbb9-91e4d88dda82 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:32.567478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5589cad9-090d-462b-bbb9-91e4d88dda82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:32.574984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1215/2405] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:32.575722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589cad9-090d-462b-bbb9-91e4d88dda82 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:32.585844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589cad9-090d-462b-bbb9-91e4d88dda82 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:32.590350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:32.590935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:32.591214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:32.591492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:32.592172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:32.594870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:32.604735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1216/2406] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:32.605485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:32.608481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:32.665963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2038aa-dc67-4a1b-bf1c-ea88cd5a5187 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:32.669672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:32.670321 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:32.670748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:32.671032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:32.680497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:32.681963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:32.691542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1217/2407] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:32.692364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:32.701299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2191b-1a58-4faa-8cfa-2fba683d5c68 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:32.706572 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ccb5e-861c-409a-b1ef-4b3a0b694a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:32.707460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccb5e-861c-409a-b1ef-4b3a0b694a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:32.707460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccb5e-861c-409a-b1ef-4b3a0b694a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:32.707751 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccb5e-861c-409a-b1ef-4b3a0b694a38 admin admin] PATH_INFO: `/v3/projects/b37c2c72454b4cfda7fb50c202e6aff1/users/37fcfe3d9e3c480db91b9dc4f9166636/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:32.723960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ccb5e-861c-409a-b1ef-4b3a0b694a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37c2c72454b4cfda7fb50c202e6aff1, user_id=37fcfe3d9e3c480db91b9dc4f9166636, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:32.726718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ccb5e-861c-409a-b1ef-4b3a0b694a38 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:32.859228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] The token cache is being invalidate because project 030255e4b76046daabe53dc560444953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:32.859596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.860714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:32.867278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1191/2409] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:31 2022] DELETE /identity/v3/projects/030255e4b76046daabe53dc560444953 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:32.867483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:32.877653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:32.888371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1218/2409] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:32 2022] PUT /identity/v3/projects/b37c2c72454b4cfda7fb50c202e6aff1/users/37fcfe3d9e3c480db91b9dc4f9166636/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:32.890762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95011-c786-490c-be93-b6a3bb5ef50e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:32.894311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95011-c786-490c-be93-b6a3bb5ef50e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:32.895171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95011-c786-490c-be93-b6a3bb5ef50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:32.961018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9bc95011-c786-490c-be93-b6a3bb5ef50e None None] MFA Rules not processed for user `37fcfe3d9e3c480db91b9dc4f9166636`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:32.962148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9bc95011-c786-490c-be93-b6a3bb5ef50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.015041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957854-2167-4eee-9888-00bc781c88aa admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:33.053934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:33.055337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1219/2410] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:33.056667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354703-dce3-48be-86d0-455011563113 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.056949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354703-dce3-48be-86d0-455011563113 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.057198 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354703-dce3-48be-86d0-455011563113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.079921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bc354703-dce3-48be-86d0-455011563113 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:33.081266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc354703-dce3-48be-86d0-455011563113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.126893 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:33.161054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:33.163496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.164117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.164615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] PATH_INFO: `/v3/projects/906cd51677c143cbb0b8b63e85a58e0a` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.166924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=906cd51677c143cbb0b8b63e85a58e0a)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:33.170050 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:33.172742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1220/2411] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:33.175791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354703-dce3-48be-86d0-455011563113 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:33.183390 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc354703-dce3-48be-86d0-455011563113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.288427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354703-dce3-48be-86d0-455011563113 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:33.293661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cac46-b9bd-4b02-975e-e3b12272013e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:33.294600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cac46-b9bd-4b02-975e-e3b12272013e service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.295201 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cac46-b9bd-4b02-975e-e3b12272013e service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.295936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cac46-b9bd-4b02-975e-e3b12272013e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.306689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cac46-b9bd-4b02-975e-e3b12272013e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:33.308308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cac46-b9bd-4b02-975e-e3b12272013e service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:33.319892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1221/2412] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:33.322802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8067a4-c4ee-49d9-976e-9abe5eac6988 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.323254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8067a4-c4ee-49d9-976e-9abe5eac6988 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.323374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8067a4-c4ee-49d9-976e-9abe5eac6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.345703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8a8067a4-c4ee-49d9-976e-9abe5eac6988 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:33.355020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8a8067a4-c4ee-49d9-976e-9abe5eac6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.355462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1222/2413] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:33.359815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8067a4-c4ee-49d9-976e-9abe5eac6988 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:33.370123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8067a4-c4ee-49d9-976e-9abe5eac6988 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:33.377468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:33.378336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.378567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.379060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.380056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:33.380404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:33.383223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:33.406728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1223/2414] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:24:33.407831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:33.424881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcbc11-d881-468a-8d07-867c5d2359d1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:33.426957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906cd51677c143cbb0b8b63e85a58e0a', 'request_id': 'req-3f4d5c80-d731-4b0f-8c23-561960afe1be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.434513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906cd51677c143cbb0b8b63e85a58e0a', 'request_id': 'req-3f4d5c80-d731-4b0f-8c23-561960afe1be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.441194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906cd51677c143cbb0b8b63e85a58e0a', 'request_id': 'req-3f4d5c80-d731-4b0f-8c23-561960afe1be'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.539579 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] The token cache is being invalidate because project 906cd51677c143cbb0b8b63e85a58e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:33.540317 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.541071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.543313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1192/2415] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:32 2022] DELETE /identity/v3/projects/906cd51677c143cbb0b8b63e85a58e0a => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:33.544192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:33.545640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.568664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e6421-8a29-4e74-8188-0e682198b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:33.570042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e6421-8a29-4e74-8188-0e682198b825 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.570442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e6421-8a29-4e74-8188-0e682198b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.570825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e6421-8a29-4e74-8188-0e682198b825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.571642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e6421-8a29-4e74-8188-0e682198b825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:33.573973 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e6421-8a29-4e74-8188-0e682198b825 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:33.600953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:33.642739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d5c80-d731-4b0f-8c23-561960afe1be admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:33.647901 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:33.648647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.649043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.649472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] PATH_INFO: `/v3/projects/2397ca5c13ea46389d420fb5445e125c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.651035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2397ca5c13ea46389d420fb5445e125c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:33.653112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:33.668651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1224/2416] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:33 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:33.668651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.668651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.668651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.695207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:33.699281 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.772571 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:33.805439 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2397ca5c13ea46389d420fb5445e125c', 'request_id': 'req-6150931a-50ef-4567-bbec-63863947977d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.816470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2397ca5c13ea46389d420fb5445e125c', 'request_id': 'req-6150931a-50ef-4567-bbec-63863947977d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.826395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2397ca5c13ea46389d420fb5445e125c', 'request_id': 'req-6150931a-50ef-4567-bbec-63863947977d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.830533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1225/2417] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:33.834427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:33.846233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.881386 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605ba85-c20b-411c-8d44-a50f7ee988ce None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:33.911592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] The token cache is being invalidate because project 2397ca5c13ea46389d420fb5445e125c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:33.911990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.912895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-6150931a-50ef-4567-bbec-63863947977d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:33.928805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1193/2418] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:33 2022] DELETE /identity/v3/projects/2397ca5c13ea46389d420fb5445e125c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:33.932378 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798493-b5d5-44c1-933c-0635d744de14 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.939560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798493-b5d5-44c1-933c-0635d744de14 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.939560 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798493-b5d5-44c1-933c-0635d744de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.971556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:33.972520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:33.973143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:33.973383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:33.974605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:33.975030 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-96798493-b5d5-44c1-933c-0635d744de14 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:33.976715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-96798493-b5d5-44c1-933c-0635d744de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:33.977334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:33.990535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1194/2419] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:34.003218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798493-b5d5-44c1-933c-0635d744de14 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.016251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798493-b5d5-44c1-933c-0635d744de14 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.023516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.024215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.024606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.025031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.025848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:34.026638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.029695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.050985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1195/2420] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:34.052479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.067530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dfa3c-71de-4eab-a30d-5dff4621a9ad admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.073710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.074855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.075201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.075555 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.076408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.079206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.094727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1226/2421] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:33 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:34.099488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.104417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:34.106007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:34.131392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900e17-459a-4190-b10f-4fa39ce9e950 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.136926 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.137573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.137912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.138196 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.138977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.141663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.174008 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1227/2422] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:34.175682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.190885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4917eb8-b4be-47b2-9651-6e91f1fa2026 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.201178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1196/2423] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:34 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:34.205605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.206262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.206682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.206834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.207985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.210523 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.214996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.223072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:34.232385 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1228/2424] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:34.232686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.248814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff87bc2-d3f0-4a91-b5a6-405b71439b8e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.368260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570add57-935c-40f1-8953-b82ffb220aaf admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.377349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.378274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.378836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.379248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.380510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.384252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.412611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.413309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.413629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.416081 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] PATH_INFO: `/v3/projects/542b35e832c847f7b98b98f0a9148800/users/64bc621216b7471c94299acb6f078da2/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.435770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542b35e832c847f7b98b98f0a9148800, user_id=64bc621216b7471c94299acb6f078da2, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.439072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.473567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1197/2425] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:34 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:34.474662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.487166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:34.494212 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f44d1-1a0b-403d-beb7-bf51f3d217af admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.500131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.501032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.501391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.501988 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.503464 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.505372 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.521784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1198/2426] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:34.525466 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.534682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec62f0e-68d3-40c5-9c98-0cf7e245d015 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.540232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd91a11-7ca9-409f-accf-43cb65b115ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.541175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91a11-7ca9-409f-accf-43cb65b115ab admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.541610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91a11-7ca9-409f-accf-43cb65b115ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.541764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91a11-7ca9-409f-accf-43cb65b115ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.542583 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd91a11-7ca9-409f-accf-43cb65b115ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.544977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd91a11-7ca9-409f-accf-43cb65b115ab admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.551953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1229/2427] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:34 2022] PUT /identity/v3/projects/542b35e832c847f7b98b98f0a9148800/users/64bc621216b7471c94299acb6f078da2/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:34.563774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1199/2428] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:34.565584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.572046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:34.624111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.624111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.625132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.660895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] MFA Rules not processed for user `64bc621216b7471c94299acb6f078da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:34.664186 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:34.664304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5934c-3e26-4408-bab3-a7e74520dc18 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.670692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8603fa-6232-4a7a-a9e0-5124abf383a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.673347 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8603fa-6232-4a7a-a9e0-5124abf383a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.673641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8603fa-6232-4a7a-a9e0-5124abf383a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.673988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8603fa-6232-4a7a-a9e0-5124abf383a2 admin admin] PATH_INFO: `/v3/projects/83dabad70b9a4961923fc21b930a8683/users/fb77ae5e810c4babba6096757f0f2c7b/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.694794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8603fa-6232-4a7a-a9e0-5124abf383a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dabad70b9a4961923fc21b930a8683, user_id=fb77ae5e810c4babba6096757f0f2c7b, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:34.697520 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8603fa-6232-4a7a-a9e0-5124abf383a2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:34.730686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1200/2429] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:34.743224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.744954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:34.778995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1230/2430] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:34 2022] PUT /identity/v3/projects/83dabad70b9a4961923fc21b930a8683/users/fb77ae5e810c4babba6096757f0f2c7b/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:34.792691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.793255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.793255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.808700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62631c-cd5f-46b9-8453-6e17c11da362 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.823472 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:34.824764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] MFA Rules not processed for user `fb77ae5e810c4babba6096757f0f2c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:34.826215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:34.904179 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1231/2431] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:34.918867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:34.922681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:34.970161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:34.989637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae6180-e6b8-497a-8a21-38a339f25380 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:34.993345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.994001 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.994283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.994888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:34.997524 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed395ec-5f25-4ee8-b3ef-47ef1089fde8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:34.998262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed395ec-5f25-4ee8-b3ef-47ef1089fde8 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:34.998498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed395ec-5f25-4ee8-b3ef-47ef1089fde8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:34.998773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed395ec-5f25-4ee8-b3ef-47ef1089fde8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:35.005287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:35.007246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:35.017178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1232/2432] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:35.038584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:35.047114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:35.074739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed395ec-5f25-4ee8-b3ef-47ef1089fde8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:35.076291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed395ec-5f25-4ee8-b3ef-47ef1089fde8 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:35.076734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:35.091308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1201/2433] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:35.115764 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776a58-cec0-42fd-a890-326d77e6206b service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:35.120344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:35.121288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:35.122070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:35.122457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:35.122800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] PATH_INFO: `/v3/users/fb77ae5e810c4babba6096757f0f2c7b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:35.124113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb77ae5e810c4babba6096757f0f2c7b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:35.126920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:35.386377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb77ae5e810c4babba6096757f0f2c7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:35.387567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb77ae5e810c4babba6096757f0f2c7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:35.417391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb77ae5e810c4babba6096757f0f2c7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:35.428915 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb77ae5e810c4babba6096757f0f2c7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:35.509104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb77ae5e810c4babba6096757f0f2c7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:35.511148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:35.520869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1233/2434] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:35 2022] DELETE /identity/v3/users/fb77ae5e810c4babba6096757f0f2c7b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:35.525367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:35.525661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:35.525976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:35.549107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:35.550758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:35.590259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:35.625684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1202/2435] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:35.639597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:35.642282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:35.723388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520de205-9a1d-4601-9957-a1b0b411c50a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:35.727263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beec39-1558-4378-aa89-f3b27122defb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:35.727889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beec39-1558-4378-aa89-f3b27122defb service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:35.728188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beec39-1558-4378-aa89-f3b27122defb service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:35.728485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beec39-1558-4378-aa89-f3b27122defb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:35.738557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beec39-1558-4378-aa89-f3b27122defb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:35.740030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beec39-1558-4378-aa89-f3b27122defb service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:35.751129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1234/2436] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:35.811203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:36.222603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:36.265974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:36.271883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:36.285568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6239e6-f21c-4cd8-9ff4-ac4b29ed28fa None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:36.300429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:36.301066 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:36.301352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:36.301979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] PATH_INFO: `/v3/projects/83dabad70b9a4961923fc21b930a8683` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:36.303159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dabad70b9a4961923fc21b930a8683)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:36.305097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:36.413267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dabad70b9a4961923fc21b930a8683', 'request_id': 'req-ccf6f54d-3508-441a-b9d5-df91de78ef13'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:36.419943 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dabad70b9a4961923fc21b930a8683', 'request_id': 'req-ccf6f54d-3508-441a-b9d5-df91de78ef13'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:36.426445 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dabad70b9a4961923fc21b930a8683', 'request_id': 'req-ccf6f54d-3508-441a-b9d5-df91de78ef13'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:36.502586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] The token cache is being invalidate because project 83dabad70b9a4961923fc21b930a8683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:36.502945 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:36.503731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ccf6f54d-3508-441a-b9d5-df91de78ef13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:36.505606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1203/2437] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:36 2022] DELETE /identity/v3/projects/83dabad70b9a4961923fc21b930a8683 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:36.511199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12543f51-736d-4b9f-aba3-1c1f666533b5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:36.511549 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12543f51-736d-4b9f-aba3-1c1f666533b5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:36.511860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12543f51-736d-4b9f-aba3-1c1f666533b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:36.533187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-12543f51-736d-4b9f-aba3-1c1f666533b5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:36.534538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-12543f51-736d-4b9f-aba3-1c1f666533b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:36.560641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:36.599263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1235/2438] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:36.607056 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195160fb-77af-4163-b5b2-78feff0374f1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:36.607344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195160fb-77af-4163-b5b2-78feff0374f1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:36.607623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195160fb-77af-4163-b5b2-78feff0374f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:36.629478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-195160fb-77af-4163-b5b2-78feff0374f1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:36.630737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-195160fb-77af-4163-b5b2-78feff0374f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:36.640942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1204/2439] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:36.645085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12543f51-736d-4b9f-aba3-1c1f666533b5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:36.654781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12543f51-736d-4b9f-aba3-1c1f666533b5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:36.659441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:36.660048 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:36.660340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:36.660668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:36.661364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:36.661677 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:36.663319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:36.676693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1236/2440] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:36.681447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195160fb-77af-4163-b5b2-78feff0374f1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:36.692422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195160fb-77af-4163-b5b2-78feff0374f1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:36.696883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:36.697653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:36.698289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:36.698574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:36.698852 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:36.699520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:36.701425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:36.778219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1205/2441] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:36 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:36.782877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:36.795088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0014a-b452-49c2-bb25-2f6af5406754 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:36.858645 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:36.859407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:36.859676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:36.859912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:36.860593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:36.862655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:36.973780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1237/2442] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:36 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:36.978069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:36.990350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83408f-03e9-4fd4-8237-efcbc35e6fe4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:36.995773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:36.996462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:36.996866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:36.997213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:36.998025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:36.999733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.011514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1206/2443] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:37.016911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.028221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8828f8-114d-4f6a-8766-ffd2bc7147c8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.039804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.040637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.041115 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.041540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.042382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.044339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.062888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.064605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1238/2444] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:37.064950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:37.069218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.081460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04663c45-8428-40ba-8477-9f1d07d258b5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.088164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c484b-5e1b-440d-bfae-03d692c8cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.089533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c484b-5e1b-440d-bfae-03d692c8cdd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.089933 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c484b-5e1b-440d-bfae-03d692c8cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.091365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c484b-5e1b-440d-bfae-03d692c8cdd2 admin admin] PATH_INFO: `/v3/projects/aa0b90e77a66411b9146a37562da3a40/users/bd7b960b44254887a5d61bb39baa0261/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.092838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d684ce8-4862-4370-b017-6e21ec5f430a admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.105046 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.106721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.106721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.106721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] PATH_INFO: `/v3/users/37fcfe3d9e3c480db91b9dc4f9166636` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.107734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fcfe3d9e3c480db91b9dc4f9166636)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.110110 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.110911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c484b-5e1b-440d-bfae-03d692c8cdd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0b90e77a66411b9146a37562da3a40, user_id=bd7b960b44254887a5d61bb39baa0261, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.113815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c484b-5e1b-440d-bfae-03d692c8cdd2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.189414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1239/2445] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:37 2022] PUT /identity/v3/projects/aa0b90e77a66411b9146a37562da3a40/users/bd7b960b44254887a5d61bb39baa0261/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:37.200250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b53d-9407-474b-b55f-e6a45331c91b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.200532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b53d-9407-474b-b55f-e6a45331c91b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.200803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b53d-9407-474b-b55f-e6a45331c91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.231984 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d622b53d-9407-474b-b55f-e6a45331c91b None None] MFA Rules not processed for user `bd7b960b44254887a5d61bb39baa0261`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:37.233226 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d622b53d-9407-474b-b55f-e6a45331c91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:37.305536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fcfe3d9e3c480db91b9dc4f9166636'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:37.307076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fcfe3d9e3c480db91b9dc4f9166636'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:37.328979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1240/2446] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:37.330958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622b53d-9407-474b-b55f-e6a45331c91b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.349195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fcfe3d9e3c480db91b9dc4f9166636'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:37.377232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:37.422315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622b53d-9407-474b-b55f-e6a45331c91b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.430123 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.437934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.437934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.437934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.437934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.437934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.548636 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fcfe3d9e3c480db91b9dc4f9166636'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:37.549280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8e093c99-1aeb-4931-a57a-5780f764230f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fcfe3d9e3c480db91b9dc4f9166636'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:37.564340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1241/2447] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:37 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:37.569463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1207/2448] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:37 2022] DELETE /identity/v3/users/37fcfe3d9e3c480db91b9dc4f9166636 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:37.569809 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.570758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151451-b017-4a75-af65-6a828fbef19b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.571166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151451-b017-4a75-af65-6a828fbef19b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.571425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151451-b017-4a75-af65-6a828fbef19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.572283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:37.605254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-98151451-b017-4a75-af65-6a828fbef19b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:37.606505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-98151451-b017-4a75-af65-6a828fbef19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:37.659103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb028-4b2b-440a-8291-2aecc772e586 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.669265 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:37.676995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1208/2449] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:37.688493 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151451-b017-4a75-af65-6a828fbef19b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.691126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-98151451-b017-4a75-af65-6a828fbef19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:37.771661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.772654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.773273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.773669 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.774567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.777920 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.808704 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151451-b017-4a75-af65-6a828fbef19b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.814426 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.815096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.815500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.815615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.830232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.832336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.849805 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1209/2450] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:37.879524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1242/2451] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:37 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:37.883612 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.897611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c5e9d-7e9c-42ca-829a-fee1fc061ced service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.904486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.905530 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.905657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.906129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.907166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.908656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:37.920895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1210/2452] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:37.925314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:37.938338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b1eec-cc62-44fb-8811-f21e1126b58e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:37.944694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:37.945963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:37.946471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:37.946975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] PATH_INFO: `/v3/projects/54fce78782284ff887ed54ebfc9795fc/users/c1a4d31c5ec84f0889c27a6b726d7757/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:37.965239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fce78782284ff887ed54ebfc9795fc, user_id=c1a4d31c5ec84f0889c27a6b726d7757, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:37.974103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:38.573032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1243/2453] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:37 2022] PUT /identity/v3/projects/54fce78782284ff887ed54ebfc9795fc/users/c1a4d31c5ec84f0889c27a6b726d7757/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:38.578242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:38.590315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4317-7a11-46de-bd9d-c8319b0b8989 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:38.672049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce918c-0091-4285-86d0-9d0b8e06e7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:38.672886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce918c-0091-4285-86d0-9d0b8e06e7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:38.673299 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce918c-0091-4285-86d0-9d0b8e06e7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:38.673580 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce918c-0091-4285-86d0-9d0b8e06e7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:38.674386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce918c-0091-4285-86d0-9d0b8e06e7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:38.676220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce918c-0091-4285-86d0-9d0b8e06e7c6 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:38.692107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1211/2454] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:38.693412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:38.706598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346d19-db9e-4e60-be7d-c6cd7af99c20 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:38.712498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:38.713753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:38.713753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:38.714526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] PATH_INFO: `/v3/projects/54fce78782284ff887ed54ebfc9795fc/users/c1a4d31c5ec84f0889c27a6b726d7757/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:38.716724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fce78782284ff887ed54ebfc9795fc, user_id=c1a4d31c5ec84f0889c27a6b726d7757, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:38.720790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:38.737679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1244/2455] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:38 2022] PUT /identity/v3/projects/54fce78782284ff887ed54ebfc9795fc/users/c1a4d31c5ec84f0889c27a6b726d7757/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:38.748699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:38.749045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:38.749431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:38.783425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] MFA Rules not processed for user `c1a4d31c5ec84f0889c27a6b726d7757`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:38.784760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:38.863794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:38.866084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:38.866335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1212/2456] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:38.895109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:38.897600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:38.953630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a936c1-e629-408b-9593-a8d97cff9f1f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:38.961857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:38.963206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:38.963470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:38.963880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] PATH_INFO: `/v3/projects/b37c2c72454b4cfda7fb50c202e6aff1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:38.965208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37c2c72454b4cfda7fb50c202e6aff1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:38.967261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:38.986776 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746f1e-6485-4c76-9153-dd0c24ee1817 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:38.991562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a912c73-34da-4dc4-bb7b-539e91afd5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:38.992958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a912c73-34da-4dc4-bb7b-539e91afd5bd service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:38.992958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a912c73-34da-4dc4-bb7b-539e91afd5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:38.993200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a912c73-34da-4dc4-bb7b-539e91afd5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:38.995496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8a912c73-34da-4dc4-bb7b-539e91afd5bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:39.077355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a912c73-34da-4dc4-bb7b-539e91afd5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:39.078930 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a912c73-34da-4dc4-bb7b-539e91afd5bd service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:39.088811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1213/2457] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:39.098823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37c2c72454b4cfda7fb50c202e6aff1', 'request_id': 'req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:39.106093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37c2c72454b4cfda7fb50c202e6aff1', 'request_id': 'req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:39.182547 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37c2c72454b4cfda7fb50c202e6aff1', 'request_id': 'req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:39.202170 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] The token cache is being invalidate because project b37c2c72454b4cfda7fb50c202e6aff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:39.203587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:39.211071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:39.212432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-01f54d87-65b0-4a4c-a2b2-3fde221e91f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:39.215022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1245/2458] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:38 2022] DELETE /identity/v3/projects/b37c2c72454b4cfda7fb50c202e6aff1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:39.221150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e446-cd69-49c6-9073-a093fe85bfc1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:39.221570 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e446-cd69-49c6-9073-a093fe85bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:39.221974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e446-cd69-49c6-9073-a093fe85bfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:39.253423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b494e446-cd69-49c6-9073-a093fe85bfc1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:39.256348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b494e446-cd69-49c6-9073-a093fe85bfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:39.277549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:39.377683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1214/2459] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:39.386220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef291-9a4a-45d0-b1db-644ff7774690 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:39.386875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef291-9a4a-45d0-b1db-644ff7774690 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:39.387255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef291-9a4a-45d0-b1db-644ff7774690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:39.410742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-874ef291-9a4a-45d0-b1db-644ff7774690 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:39.413779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-874ef291-9a4a-45d0-b1db-644ff7774690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:39.420780 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1246/2460] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:39.425201 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e446-cd69-49c6-9073-a093fe85bfc1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:39.439488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e446-cd69-49c6-9073-a093fe85bfc1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:39.448377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:39.449862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:39.450494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:39.450937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:39.452073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:39.453198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:39.455763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:39.470044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1215/2461] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:39.474372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef291-9a4a-45d0-b1db-644ff7774690 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:39.485152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef291-9a4a-45d0-b1db-644ff7774690 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:39.493765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:39.493765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:39.493765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:39.493765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:39.494217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:39.494909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:39.590706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1247/2462] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:39 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:39.594937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:39.604890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234002e-b8c0-4653-ab60-7378fe6ac592 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:39.691448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:39.692077 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:39.692365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:39.692645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:39.693522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:39.696677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:39.725518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:39.816630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1216/2463] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:39 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:39.818069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:39.829093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fadae-74a4-4918-a1f3-be42ea3f7dfc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:39.838352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:39.838995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:39.839280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:39.839648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:39.840258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:39.841914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:40.001765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1248/2464] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:40.005927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:40.017542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0210-7618-4393-ab64-6df7640daef4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:40.022472 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeb7c0-3578-4d72-b7cd-711e9979bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:40.023363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb7c0-3578-4d72-b7cd-711e9979bd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:40.023723 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb7c0-3578-4d72-b7cd-711e9979bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:40.024176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb7c0-3578-4d72-b7cd-711e9979bd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:40.024941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aeb7c0-3578-4d72-b7cd-711e9979bd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:40.026644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aeb7c0-3578-4d72-b7cd-711e9979bd73 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:40.041871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1217/2465] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:40.044853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:40.057770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42320a-fc1d-4081-9fd7-55444c23521a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:40.061823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:40.062424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:40.062702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:40.063053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] PATH_INFO: `/v3/projects/7af59bbdbea64841861072ca371647c1/users/4e75e7023b9a4e7083d31f9593910ff0/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:40.081388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af59bbdbea64841861072ca371647c1, user_id=4e75e7023b9a4e7083d31f9593910ff0, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:40.084295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:40.191424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1249/2466] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:40 2022] PUT /identity/v3/projects/7af59bbdbea64841861072ca371647c1/users/4e75e7023b9a4e7083d31f9593910ff0/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:40.201460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a991-8660-4bd6-841d-950eed0eba16 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:40.201460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a991-8660-4bd6-841d-950eed0eba16 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:40.201460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a991-8660-4bd6-841d-950eed0eba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:40.227631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-96e8a991-8660-4bd6-841d-950eed0eba16 None None] MFA Rules not processed for user `4e75e7023b9a4e7083d31f9593910ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:40.228887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-96e8a991-8660-4bd6-841d-950eed0eba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:40.236220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:40.298137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1218/2467] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:40.319620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:40.321781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:40.337487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911076f-6f52-4b0a-895c-0f39a2a17352 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:40.337808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911076f-6f52-4b0a-895c-0f39a2a17352 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:40.338209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911076f-6f52-4b0a-895c-0f39a2a17352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-4911076f-6f52-4b0a-895c-0f39a2a17352 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:24:40.345708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:24:40.347074 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:24:40.348250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1219/2468] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:24:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:24:40.396822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f832c-4178-4ca8-a15f-71bfb6bec2eb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:40.401301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:40.402441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:40.408134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:40.408134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:40.411965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:40.413429 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:40.422837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1250/2469] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:40.912498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:41.353309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561359-9e82-448f-b281-d6d69750d2a2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:41.353814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561359-9e82-448f-b281-d6d69750d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:41.353929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561359-9e82-448f-b281-d6d69750d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:41.376798 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f9561359-9e82-448f-b281-d6d69750d2a2 None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:41.378203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9561359-9e82-448f-b281-d6d69750d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:41.394488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:41.444269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1220/2470] 10.222.0.71 () {58 vars in 967 bytes} [Tue Aug 2 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:41.461743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:41.463257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:41.559776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23f075-1c34-42d4-bdfa-b691b5a5d60c service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:41.565591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91c2e-5e9d-4f28-974a-ed191a190e9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:41.566275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c2e-5e9d-4f28-974a-ed191a190e9e service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:41.566563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c2e-5e9d-4f28-974a-ed191a190e9e service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:41.566850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c2e-5e9d-4f28-974a-ed191a190e9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:41.574959 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91c2e-5e9d-4f28-974a-ed191a190e9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:41.577058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91c2e-5e9d-4f28-974a-ed191a190e9e service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:41.586304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1251/2471] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:24:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:24:42.131167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:42.162255 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9561359-9e82-448f-b281-d6d69750d2a2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:42.171565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9561359-9e82-448f-b281-d6d69750d2a2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:42.175911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:42.176513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:42.176800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:42.177075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:42.178880 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:42.246025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:42.247459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:42.257884 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1221/2472] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:42.336986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cc688-6d8e-40e9-b736-3ce2f9aaf5c4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:42.337272 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cc688-6d8e-40e9-b736-3ce2f9aaf5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:42.337579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cc688-6d8e-40e9-b736-3ce2f9aaf5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:42.357475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-490cc688-6d8e-40e9-b736-3ce2f9aaf5c4 None None] MFA Rules not processed for user `4e75e7023b9a4e7083d31f9593910ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:42.358875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-490cc688-6d8e-40e9-b736-3ce2f9aaf5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:42.366989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1252/2473] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:42.474834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:42.707746 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:42.709187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:42.801817 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971774e3-6df0-4e2c-9876-8a28cbd17245 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:42.814136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:42.814136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:42.814321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:42.815420 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] PATH_INFO: `/v3/users/bd7b960b44254887a5d61bb39baa0261` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:42.815829 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7b960b44254887a5d61bb39baa0261)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:42.817866 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:42.931421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:43.115084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7b960b44254887a5d61bb39baa0261'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:43.115971 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7b960b44254887a5d61bb39baa0261'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:43.135006 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7b960b44254887a5d61bb39baa0261'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:43.245845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7b960b44254887a5d61bb39baa0261'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:43.246491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7b960b44254887a5d61bb39baa0261'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:43.262427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1222/2474] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:42 2022] DELETE /identity/v3/users/bd7b960b44254887a5d61bb39baa0261 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:43.267284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:43.267708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:43.268085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:43.288125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:43.289506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:43.372516 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1253/2475] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:43.386013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:43.387578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:43.421949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:43.430403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:43.470533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fa5bd-3198-45f5-a9a7-0c9ee75533f9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:43.475084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:43.479071 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:43.479393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:43.479677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:43.492114 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:43.493826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:43.518200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1223/2476] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:43.531171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:43.540541 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d2dd3-3a36-4e9c-9018-fc80faa85873 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:43.545865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41aaa2d337974ae29ef28b1126e70435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:43.546702 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:43.546986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:43.547268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:43.550418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:43.562316 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:43.563948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:43.574635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1254/2477] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:43.975663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:43.976161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:43.989823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bde59-dabe-492c-9dae-0fb32a21b667 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:43.994922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:43.995705 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:43.996041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:43.998633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] PATH_INFO: `/v3/projects/aa0b90e77a66411b9146a37562da3a40` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:43.998633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0b90e77a66411b9146a37562da3a40)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:43.999448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:44.128331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0b90e77a66411b9146a37562da3a40', 'request_id': 'req-d63a1671-111c-4738-850a-004552d66b12'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.134835 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0b90e77a66411b9146a37562da3a40', 'request_id': 'req-d63a1671-111c-4738-850a-004552d66b12'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.140407 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0b90e77a66411b9146a37562da3a40', 'request_id': 'req-d63a1671-111c-4738-850a-004552d66b12'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.227621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] The token cache is being invalidate because project aa0b90e77a66411b9146a37562da3a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:44.228022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.228748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.230919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1224/2478] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:43 2022] DELETE /identity/v3/projects/aa0b90e77a66411b9146a37562da3a40 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:44.234368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:44.237852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:44.249207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60bb7-5391-4697-8f0c-e22a2cd3ce18 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:44.345373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:44.346315 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:44.346712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:44.347096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] PATH_INFO: `/v3/users/c1a4d31c5ec84f0889c27a6b726d7757` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:44.348363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a4d31c5ec84f0889c27a6b726d7757)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:44.350419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:44.597050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a4d31c5ec84f0889c27a6b726d7757'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.597884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a4d31c5ec84f0889c27a6b726d7757'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.609684 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a4d31c5ec84f0889c27a6b726d7757'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.621505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a4d31c5ec84f0889c27a6b726d7757'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.704325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a4d31c5ec84f0889c27a6b726d7757'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:44.712607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1255/2479] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:44 2022] DELETE /identity/v3/users/c1a4d31c5ec84f0889c27a6b726d7757 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:44.801562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:44.936345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:45.051920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:45.054043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:45.072428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a1671-111c-4738-850a-004552d66b12 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:45.141079 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:45.142490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:45.142681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:45.143031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] PATH_INFO: `/v3/users/df8374b04fd142a8a97503e0a0774960` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:45.144291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8374b04fd142a8a97503e0a0774960)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:45.146534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:45.356573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:45.359921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:45.375414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c4a6-2d9c-4757-83ed-064b4ba8b642 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:45.380380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:45.381051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:45.381331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:45.381632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] PATH_INFO: `/v3/projects/54fce78782284ff887ed54ebfc9795fc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:45.382985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fce78782284ff887ed54ebfc9795fc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:45.384942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:45.408658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8374b04fd142a8a97503e0a0774960'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.409381 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8374b04fd142a8a97503e0a0774960'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.423952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8374b04fd142a8a97503e0a0774960'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.536348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8374b04fd142a8a97503e0a0774960'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.538967 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-de7f4e24-72fa-4356-b65e-9260ef370520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8374b04fd142a8a97503e0a0774960'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.554394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1225/2480] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:45 2022] DELETE /identity/v3/users/df8374b04fd142a8a97503e0a0774960 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:45.558674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fce78782284ff887ed54ebfc9795fc', 'request_id': 'req-759f0577-693e-4424-80b7-43be37a1cd7f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.565576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fce78782284ff887ed54ebfc9795fc', 'request_id': 'req-759f0577-693e-4424-80b7-43be37a1cd7f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.678662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fce78782284ff887ed54ebfc9795fc', 'request_id': 'req-759f0577-693e-4424-80b7-43be37a1cd7f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.705687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] The token cache is being invalidate because project 54fce78782284ff887ed54ebfc9795fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:45.706473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.707344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:45.710361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1256/2481] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:45 2022] DELETE /identity/v3/projects/54fce78782284ff887ed54ebfc9795fc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:45.723232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee4f5-fdd5-4267-870b-512d964bdda2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:45.723232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee4f5-fdd5-4267-870b-512d964bdda2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:45.723232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee4f5-fdd5-4267-870b-512d964bdda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:45.768645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5dbee4f5-fdd5-4267-870b-512d964bdda2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:45.771283 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5dbee4f5-fdd5-4267-870b-512d964bdda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:45.849596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:45.851241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:45.861861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1226/2482] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:45.872631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1677-31ee-46ed-8db9-970971eaa131 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:45.873040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1677-31ee-46ed-8db9-970971eaa131 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:45.873537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1677-31ee-46ed-8db9-970971eaa131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:45.899489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b6ad1677-31ee-46ed-8db9-970971eaa131 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:45.902353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b6ad1677-31ee-46ed-8db9-970971eaa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:45.910889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1227/2483] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:45.914622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1677-31ee-46ed-8db9-970971eaa131 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:45.925065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1677-31ee-46ed-8db9-970971eaa131 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:45.932551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:45.935415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:45.935415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:45.935415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:45.935415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:45.935415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:45.937468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:45.955469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1228/2484] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:24:45.956438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:45.957394 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0577-693e-4424-80b7-43be37a1cd7f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:45.962788 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:45.963855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:45.964287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:45.964719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] PATH_INFO: `/v3/projects/c89989d20f194e47b291339bde161549` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:45.966124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89989d20f194e47b291339bde161549)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:45.968205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:45.972635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b8aa-a2c9-4486-a92c-29a821f708fb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:45.977982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:45.978666 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:45.978952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:45.979230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:45.980073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:45.982087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.106849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1229/2485] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:45 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:46.106849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.115127 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.125209 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89989d20f194e47b291339bde161549', 'request_id': 'req-4ac9c97f-f556-4da2-8a21-590fb89d2329'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.133299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89989d20f194e47b291339bde161549', 'request_id': 'req-4ac9c97f-f556-4da2-8a21-590fb89d2329'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.171168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:46.183442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87acc00-9dea-4cd3-a6eb-1e57202c9658 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.188554 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.189187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.189469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.189774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] PATH_INFO: `/v3/users/b7f95bc23b9e4588a4b708bebd104be9` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.191004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f95bc23b9e4588a4b708bebd104be9)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.193028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.209609 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89989d20f194e47b291339bde161549', 'request_id': 'req-4ac9c97f-f556-4da2-8a21-590fb89d2329'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.233267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] The token cache is being invalidate because project c89989d20f194e47b291339bde161549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:46.233658 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.235231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.237332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1257/2486] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:45 2022] DELETE /identity/v3/projects/c89989d20f194e47b291339bde161549 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:24:46.238309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.246355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.257326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:46.309518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c97f-f556-4da2-8a21-590fb89d2329 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.314214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c54a6-dccc-49b0-8179-19b86e2cdb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.314828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c54a6-dccc-49b0-8179-19b86e2cdb12 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.315109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c54a6-dccc-49b0-8179-19b86e2cdb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.315383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c54a6-dccc-49b0-8179-19b86e2cdb12 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.316051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c54a6-dccc-49b0-8179-19b86e2cdb12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.318003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c54a6-dccc-49b0-8179-19b86e2cdb12 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.361523 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f95bc23b9e4588a4b708bebd104be9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.362200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f95bc23b9e4588a4b708bebd104be9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.374473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f95bc23b9e4588a4b708bebd104be9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.417286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1258/2487] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:46 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:46.418753 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83552-1ac1-4d07-b2fa-91b6c7404eee None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.419011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83552-1ac1-4d07-b2fa-91b6c7404eee None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.419288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83552-1ac1-4d07-b2fa-91b6c7404eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.434850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f95bc23b9e4588a4b708bebd104be9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.435492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f95bc23b9e4588a4b708bebd104be9'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:46.445174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-efb83552-1ac1-4d07-b2fa-91b6c7404eee None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:46.446421 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-efb83552-1ac1-4d07-b2fa-91b6c7404eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.450117 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1230/2488] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:46 2022] DELETE /identity/v3/users/b7f95bc23b9e4588a4b708bebd104be9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:46.451011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.452345 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.458221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1259/2489] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:46.459306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b26a-3adb-425a-97a6-5761fa6251f1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.459591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b26a-3adb-425a-97a6-5761fa6251f1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.459870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b26a-3adb-425a-97a6-5761fa6251f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.479563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-58a9b26a-3adb-425a-97a6-5761fa6251f1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:46.481102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-58a9b26a-3adb-425a-97a6-5761fa6251f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.529280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74320a-381a-49b4-86a9-9134d3fbc2ad admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.534657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.535280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.535559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.535831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.536521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.538249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.544797 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1260/2490] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:46.545338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50fc77-dd86-4aea-892a-771e3f3e09b8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.545629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50fc77-dd86-4aea-892a-771e3f3e09b8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.545938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50fc77-dd86-4aea-892a-771e3f3e09b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.553962 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1231/2491] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:46.557293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.557293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.568098 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0f50fc77-dd86-4aea-892a-771e3f3e09b8 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:46.569289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0f50fc77-dd86-4aea-892a-771e3f3e09b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.577752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1261/2492] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:46.578564 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50fc77-dd86-4aea-892a-771e3f3e09b8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.588560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50fc77-dd86-4aea-892a-771e3f3e09b8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.593631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.594923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.595393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.595858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.596562 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.598440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.608488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1262/2493] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:46.609275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.619840 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4808fe0-df88-4660-8300-6cdad41b3d15 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.623282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bed82-fd73-440a-88c9-b2090aa46172 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.624338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.624919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.625197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.626077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.627096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:46.627404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.627617 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.628229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.628514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.628787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.628983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.645461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.645461 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.645617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1263/2494] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:46.645617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.652615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1232/2495] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:24:46.653473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.654264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae1a2-628d-4d8f-b4f6-1151450b5b08 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.659481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166224c0-8ff9-4db9-b433-7aec696576bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.660151 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166224c0-8ff9-4db9-b433-7aec696576bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.660438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166224c0-8ff9-4db9-b433-7aec696576bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.661149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166224c0-8ff9-4db9-b433-7aec696576bd admin admin] PATH_INFO: `/v3/projects/67f80a433ec94cf1ba78476615bbcd83/users/db7e0e771edc4659b9f5d3d88aa65a2d/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.666522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a1456-0562-4f82-879e-15ba326b5e2d service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.671367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.680425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.680425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.680425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.680425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.680425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.680881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166224c0-8ff9-4db9-b433-7aec696576bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f80a433ec94cf1ba78476615bbcd83, user_id=db7e0e771edc4659b9f5d3d88aa65a2d, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.681119 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166224c0-8ff9-4db9-b433-7aec696576bd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.793810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1264/2496] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:46 2022] PUT /identity/v3/projects/67f80a433ec94cf1ba78476615bbcd83/users/db7e0e771edc4659b9f5d3d88aa65a2d/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:46.794741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1233/2497] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:46 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:46.799580 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:46.799994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08430-8cac-45af-bdf6-2fca1ad63288 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.800283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08430-8cac-45af-bdf6-2fca1ad63288 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.800592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08430-8cac-45af-bdf6-2fca1ad63288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.822295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:46.827614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f4d08430-8cac-45af-bdf6-2fca1ad63288 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:46.829031 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f4d08430-8cac-45af-bdf6-2fca1ad63288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:46.904550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:46.928222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892528a1-4910-4116-ad77-7b7675f85a91 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:46.933639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:46.935200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:46.935681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:46.936144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:46.936996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:46.940253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:46.950679 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1265/2498] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:46.958811 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d08430-8cac-45af-bdf6-2fca1ad63288 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:47.036735 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d08430-8cac-45af-bdf6-2fca1ad63288 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:47.044965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:47.046882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.047221 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.050396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.062532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:47.065339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:47.079165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1266/2499] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:47.121176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1234/2500] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:46 2022] POST /identity/v3/users => generated 284 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:47.137574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:47.138543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:47.161154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:47.174166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378e16-44c0-4b06-952c-15728f97e731 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:47.176841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:47.188942 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4f75-5328-4e99-9465-2163bfdac4e8 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:47.199664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:47.201997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.202324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.202608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.203599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:47.205193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:47.210478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:47.213000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.213000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.213000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] PATH_INFO: `/v3/projects/0856392e6db1424c98332f02fb065baa` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.213000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0856392e6db1424c98332f02fb065baa)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:47.220363 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:47.238634 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1235/2501] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:47.242655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:47.264339 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663adcb-ac12-4b2f-888e-e8cf66cb91cd admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:47.277521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:47.278190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.278477 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.278755 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.279518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:47.281142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:47.300664 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1236/2502] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:47.304856 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:47.315209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568238-9e17-43aa-a0df-ba6f3b893c3f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:47.321041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579ed26-42a2-4702-b02a-c93d208d56d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:47.322175 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ed26-42a2-4702-b02a-c93d208d56d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.322402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ed26-42a2-4702-b02a-c93d208d56d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.322686 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ed26-42a2-4702-b02a-c93d208d56d9 admin admin] PATH_INFO: `/v3/projects/f3862c7d0d844d1f81d014f40a28ccd6/users/4a389b840d504d3b84e87642cb137f98/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.339412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579ed26-42a2-4702-b02a-c93d208d56d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3862c7d0d844d1f81d014f40a28ccd6, user_id=4a389b840d504d3b84e87642cb137f98, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:47.345701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579ed26-42a2-4702-b02a-c93d208d56d9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:47.460681 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1237/2503] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:47 2022] PUT /identity/v3/projects/f3862c7d0d844d1f81d014f40a28ccd6/users/4a389b840d504d3b84e87642cb137f98/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:47.465073 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.465614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.467203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.487424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:47.489597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:47.530091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0856392e6db1424c98332f02fb065baa', 'request_id': 'req-22f328af-fed8-4c67-b679-b9eee94d2050'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:47.546297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0856392e6db1424c98332f02fb065baa', 'request_id': 'req-22f328af-fed8-4c67-b679-b9eee94d2050'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:47.578401 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1238/2504] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:24:47.588703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:47.590279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:47.636397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0856392e6db1424c98332f02fb065baa', 'request_id': 'req-22f328af-fed8-4c67-b679-b9eee94d2050'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:47.662425 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] The token cache is being invalidate because project 0856392e6db1424c98332f02fb065baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:47.663240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:47.666057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:47.679543 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1267/2505] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:47 2022] DELETE /identity/v3/projects/0856392e6db1424c98332f02fb065baa => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:47.683958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:47.692880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:47.736587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebb97-a624-4c5c-a5db-c230ab269dd2 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:47.743086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:47.811536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f328af-fed8-4c67-b679-b9eee94d2050 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:47.813887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9308010-23cc-405e-ad5b-75e2bf7f4c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:47.815111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308010-23cc-405e-ad5b-75e2bf7f4c98 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.815397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308010-23cc-405e-ad5b-75e2bf7f4c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.815709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308010-23cc-405e-ad5b-75e2bf7f4c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.818898 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a9308010-23cc-405e-ad5b-75e2bf7f4c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:47.822882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:47.823548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:47.823821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:47.824137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] PATH_INFO: `/v3/users/e5f97d7262a24a908c921a1c60084626` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:47.825322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f97d7262a24a908c921a1c60084626)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:47.830843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:47.842424 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9308010-23cc-405e-ad5b-75e2bf7f4c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:47.843903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9308010-23cc-405e-ad5b-75e2bf7f4c98 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:47.855692 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1239/2506] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:48.087084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f97d7262a24a908c921a1c60084626'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:48.088853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f97d7262a24a908c921a1c60084626'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:48.130724 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf51f-8d47-4c0d-9f95-cc839f29ae1f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:48.131567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf51f-8d47-4c0d-9f95-cc839f29ae1f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:48.132020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf51f-8d47-4c0d-9f95-cc839f29ae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:48.132217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f97d7262a24a908c921a1c60084626'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:48.142728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f97d7262a24a908c921a1c60084626'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:48.162136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2faaf51f-8d47-4c0d-9f95-cc839f29ae1f None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:48.163374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2faaf51f-8d47-4c0d-9f95-cc839f29ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:48.230560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f97d7262a24a908c921a1c60084626'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:48.239657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1268/2507] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:47 2022] DELETE /identity/v3/users/e5f97d7262a24a908c921a1c60084626 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:48.243958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1240/2508] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:24:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:48.266346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:48.267579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:48.358923 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04b69-3279-4ffc-9afa-c0606e148ff0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:48.365786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:48.366672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:48.366925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:48.367199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:48.464056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:48.475602 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:48.505744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1269/2509] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:24:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:24:48.580110 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:48.863109 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:49.418440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2f85-9a9d-4ae9-a5e2-73267299a0af None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:49.418440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2f85-9a9d-4ae9-a5e2-73267299a0af None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:49.419275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2f85-9a9d-4ae9-a5e2-73267299a0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:49.500165 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-ca3e2f85-9a9d-4ae9-a5e2-73267299a0af None None] MFA Rules not processed for user `8f8fdc63709648dfbefb06f1b2db7ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:49.502210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ca3e2f85-9a9d-4ae9-a5e2-73267299a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:49.585591 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1241/2510] 10.222.0.104 () {58 vars in 1016 bytes} [Tue Aug 2 09:24:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:49.781611 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:49.784397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:49.946455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926d45-df4f-4e03-b52b-d1a24fae70d0 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:49.962997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:49.963639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:49.964501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:49.964714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] PATH_INFO: `/v3/projects/f7afe1cae1fb4bfd9cd4cb5cc2e668c3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:49.968306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7afe1cae1fb4bfd9cd4cb5cc2e668c3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:49.977223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:50.054528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:50.143637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7afe1cae1fb4bfd9cd4cb5cc2e668c3', 'request_id': 'req-5a820ccf-22c4-45ad-ad32-9eee43161c07'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:50.160493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7afe1cae1fb4bfd9cd4cb5cc2e668c3', 'request_id': 'req-5a820ccf-22c4-45ad-ad32-9eee43161c07'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:50.286837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7afe1cae1fb4bfd9cd4cb5cc2e668c3', 'request_id': 'req-5a820ccf-22c4-45ad-ad32-9eee43161c07'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:50.332232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] The token cache is being invalidate because project f7afe1cae1fb4bfd9cd4cb5cc2e668c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:24:50.332232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:50.332232 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:50.340250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1270/2511] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:24:49 2022] DELETE /identity/v3/projects/f7afe1cae1fb4bfd9cd4cb5cc2e668c3 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:50.342145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e57d0-879c-4528-887d-0b827b936535 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:50.342443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e57d0-879c-4528-887d-0b827b936535 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:50.342728 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e57d0-879c-4528-887d-0b827b936535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:50.392736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b14e57d0-879c-4528-887d-0b827b936535 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:50.394417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b14e57d0-879c-4528-887d-0b827b936535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:50.472297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:50.474510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:50.516387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1242/2512] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:50.533794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd539416-f18b-4456-917b-a89d6283fee7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:50.534084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd539416-f18b-4456-917b-a89d6283fee7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:50.536665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd539416-f18b-4456-917b-a89d6283fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:50.571622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-bd539416-f18b-4456-917b-a89d6283fee7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:50.574280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bd539416-f18b-4456-917b-a89d6283fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:50.580665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820ccf-22c4-45ad-ad32-9eee43161c07 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:50.603512 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1243/2513] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:50.603731 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:50.604100 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd539416-f18b-4456-917b-a89d6283fee7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:50.604212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:50.604212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:50.604212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:50.604212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:50.614418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd539416-f18b-4456-917b-a89d6283fee7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:50.623934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:50.629269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:50.630223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:50.633017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:50.633017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:50.633017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:24:50.633017 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:50.635026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:50.635632 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:50.640776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:50.655423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1244/2514] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:24:50.659197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:50.685864 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794514-41a9-45e2-822e-90d29c762813 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:50.686963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1271/2515] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:50.697243 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:50.697900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:50.698188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:50.698468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:50.699137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:50.702327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:50.968774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1245/2516] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:50 2022] POST /identity/v3/projects => generated 365 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:50.974194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:50.992532 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea43ff9-d1e1-4f75-90eb-7b5803ba83b6 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:51.208136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:51.210857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:51.210857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:51.210857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:51.210857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:51.212449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:51.334774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1272/2517] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:50 2022] POST /identity/v3/users => generated 283 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:51.338977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:51.370330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e45f6-0211-4a83-b40d-79b547fe4245 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:51.390151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:51.391827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:51.392587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:51.393141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:51.395626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:51.397784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:51.431171 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1246/2518] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:51.435071 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:51.454357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103b457-5c9a-4e6e-97ff-545d44d49bf3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:51.487389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9846-1e5d-4b45-b38b-17d80b19a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:51.492409 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9846-1e5d-4b45-b38b-17d80b19a2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:51.493525 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9846-1e5d-4b45-b38b-17d80b19a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:51.496357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9846-1e5d-4b45-b38b-17d80b19a2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:51.497440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef9846-1e5d-4b45-b38b-17d80b19a2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:51.507097 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef9846-1e5d-4b45-b38b-17d80b19a2f6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:51.575545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:51.590503 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893a247-45cb-47fc-93ec-0f2ee473221d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:51.595805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1273/2519] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:51.624582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:51.632130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:51.632130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:51.632130 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] PATH_INFO: `/v3/projects/196d520e00a54b51a3fe693803ff3546/users/6f74cb8782384b2c910115585de6369c/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:51.706173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196d520e00a54b51a3fe693803ff3546, user_id=6f74cb8782384b2c910115585de6369c, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:51.716513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:51.818376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1247/2520] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:51 2022] PUT /identity/v3/projects/196d520e00a54b51a3fe693803ff3546/users/6f74cb8782384b2c910115585de6369c/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:51.830758 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc9f4-ff38-47c7-a0a6-e5ac38e5e9b3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:51.831437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc9f4-ff38-47c7-a0a6-e5ac38e5e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:51.831934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc9f4-ff38-47c7-a0a6-e5ac38e5e9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:51.912067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-20dbc9f4-ff38-47c7-a0a6-e5ac38e5e9b3 None None] MFA Rules not processed for user `6f74cb8782384b2c910115585de6369c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:51.913761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-20dbc9f4-ff38-47c7-a0a6-e5ac38e5e9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:52.166331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:52.312608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1274/2521] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:52.326225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:52.651714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f07c6-1f42-4815-bc6a-c1054979b958 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:52.677914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8062854-ca2c-4daa-83d8-bef219879b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:52.677914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8062854-ca2c-4daa-83d8-bef219879b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:52.677914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8062854-ca2c-4daa-83d8-bef219879b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:52.677914 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8062854-ca2c-4daa-83d8-bef219879b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:52.678729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8062854-ca2c-4daa-83d8-bef219879b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:52.681400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8062854-ca2c-4daa-83d8-bef219879b40 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:52.761174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:52.900292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1248/2522] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:24:52 2022] POST /identity/v3/projects => generated 367 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:24:52.904327 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbc9f4-ff38-47c7-a0a6-e5ac38e5e9b3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:52.944255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbc9f4-ff38-47c7-a0a6-e5ac38e5e9b3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:53.148144 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:53.148999 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:53.149967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:53.150448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:53.151304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:53.156070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:53.178641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e78e64-4198-45f7-a7a5-02b6ee1b0101 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:53.182027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e78e64-4198-45f7-a7a5-02b6ee1b0101 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:53.182027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e78e64-4198-45f7-a7a5-02b6ee1b0101 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:53.182027 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1249/2523] 10.222.0.71 () {54 vars in 921 bytes} [Tue Aug 2 09:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:24:53.219958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e703-bc66-4afd-8901-7c847e28e0b9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:53.221505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e703-bc66-4afd-8901-7c847e28e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:53.222215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e703-bc66-4afd-8901-7c847e28e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:53.288808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1275/2524] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:24:52 2022] POST /identity/v3/users => generated 290 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:24:53.290721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5082e703-bc66-4afd-8901-7c847e28e0b9 None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:53.293296 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:53.294292 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5082e703-bc66-4afd-8901-7c847e28e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:53.338346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16987a-b2cb-4b23-8e3a-62f7348d626f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:53.363737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:53.367556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:53.368231 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:53.371292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:53.377283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:53.383319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:53.425311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1276/2525] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:24:53.437389 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:53.450983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9d788-7e0d-4d13-8acd-36fa45b44e63 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:53.461003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:53.462340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:53.464714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:53.465535 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] PATH_INFO: `/v3/projects/bba877ee31014d65a7d6e96fe523613d/users/16d5a475cdab49e09190dac08634ea8e/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:53.550696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba877ee31014d65a7d6e96fe523613d, user_id=16d5a475cdab49e09190dac08634ea8e, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:53.577561 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:53.655385 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1250/2526] 10.222.0.71 () {58 vars in 1018 bytes} [Tue Aug 2 09:24:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:53.726427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1277/2527] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:53 2022] PUT /identity/v3/projects/bba877ee31014d65a7d6e96fe523613d/users/16d5a475cdab49e09190dac08634ea8e/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:53.730739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082e703-bc66-4afd-8901-7c847e28e0b9 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:53.749397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082e703-bc66-4afd-8901-7c847e28e0b9 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:53.765452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:53.774526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:54.078682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9c6a-2886-452c-a7b1-d8508edb340d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:54.100730 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:54.101499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498dd59-b0cb-49a0-9878-6e5b0377e775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:54.101778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:54.102161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:54.102615 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:54.103481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498dd59-b0cb-49a0-9878-6e5b0377e775 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:54.103932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:54.104348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498dd59-b0cb-49a0-9878-6e5b0377e775 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:54.104799 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498dd59-b0cb-49a0-9878-6e5b0377e775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:54.108828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:54.136111 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1251/2528] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:24:54.140427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:54.160954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c9a4c-b2f2-49c6-9caa-dd788c1e8ace admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:54.165837 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498dd59-b0cb-49a0-9878-6e5b0377e775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:54.170383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498dd59-b0cb-49a0-9878-6e5b0377e775 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:54.179762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:54.181470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:54.181931 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:54.182458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] PATH_INFO: `/v3/projects/bba877ee31014d65a7d6e96fe523613d/users/16d5a475cdab49e09190dac08634ea8e/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:54.185542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba877ee31014d65a7d6e96fe523613d, user_id=16d5a475cdab49e09190dac08634ea8e, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:54.192305 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:54.212383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1278/2529] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:54.218948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1252/2530] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:24:54 2022] PUT /identity/v3/projects/bba877ee31014d65a7d6e96fe523613d/users/16d5a475cdab49e09190dac08634ea8e/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:54.230172 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bbe84-c4e9-4682-aa41-f64ea57aff75 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:54.230533 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bbe84-c4e9-4682-aa41-f64ea57aff75 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:54.231076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bbe84-c4e9-4682-aa41-f64ea57aff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:54.235594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:54.311817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-063bbe84-c4e9-4682-aa41-f64ea57aff75 None None] MFA Rules not processed for user `16d5a475cdab49e09190dac08634ea8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:54.315768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-063bbe84-c4e9-4682-aa41-f64ea57aff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:54.565331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1279/2531] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:54.577772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:54.581295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:54.650302 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:54.715525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06405a9-ff6f-4daa-a344-e2002fa81ba5 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:54.728444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:54.728444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:54.728444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:54.728444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:54.751485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:54.753116 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:54.791370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1253/2532] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:55.011876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bbe84-c4e9-4682-aa41-f64ea57aff75 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:55.025410 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bbe84-c4e9-4682-aa41-f64ea57aff75 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:55.041195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcdc47-fdfc-42d7-bc91-85fe91c009a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:55.042258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcdc47-fdfc-42d7-bc91-85fe91c009a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:55.042749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcdc47-fdfc-42d7-bc91-85fe91c009a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:55.043243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcdc47-fdfc-42d7-bc91-85fe91c009a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:55.209448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcdc47-fdfc-42d7-bc91-85fe91c009a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:55.213663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcdc47-fdfc-42d7-bc91-85fe91c009a5 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:55.224956 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1280/2533] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:56.040639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:56.622863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:57.131064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:57.132708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:57.358721 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72388df-9af2-4f10-be2f-a84bd90192c5 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:57.380005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:57.383365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:57.385657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:57.387465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] PATH_INFO: `/v3/users/64bc621216b7471c94299acb6f078da2` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:57.393629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bc621216b7471c94299acb6f078da2)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:57.397094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:57.643406 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bc621216b7471c94299acb6f078da2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:57.645537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bc621216b7471c94299acb6f078da2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:57.694881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bc621216b7471c94299acb6f078da2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:57.848043 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bc621216b7471c94299acb6f078da2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:57.849277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bc621216b7471c94299acb6f078da2'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:24:57.904246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1254/2534] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:24:57 2022] DELETE /identity/v3/users/64bc621216b7471c94299acb6f078da2 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:24:57.906055 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:57.906642 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:57.906854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:57.946996 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:24:57.948295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:58.240043 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1281/2535] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:24:58.241410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:58.265514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:24:58.265514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:24:58.409366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43f733-4029-4888-bb33-f8852f3bde5b admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:24:58.428574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9b4b-da66-432a-a76e-5abdb11619d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:24:58.432429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9b4b-da66-432a-a76e-5abdb11619d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:24:58.432429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9b4b-da66-432a-a76e-5abdb11619d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:24:58.432429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9b4b-da66-432a-a76e-5abdb11619d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:24:58.461921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9b4b-da66-432a-a76e-5abdb11619d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:24:58.472791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9b4b-da66-432a-a76e-5abdb11619d5 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:24:58.515767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1255/2536] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:24:59.270867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:59.628805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:00.817870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:01.002121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:01.003625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:01.022049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9460956-accb-4dd9-9e07-ca0ec5830026 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:01.067947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:01.069291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:01.069949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:01.070508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] PATH_INFO: `/v3/projects/542b35e832c847f7b98b98f0a9148800` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:01.074721 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542b35e832c847f7b98b98f0a9148800)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:01.077470 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:01.226437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:01.290053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542b35e832c847f7b98b98f0a9148800', 'request_id': 'req-7cbea998-2c57-4093-83e7-f346a316b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.300506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542b35e832c847f7b98b98f0a9148800', 'request_id': 'req-7cbea998-2c57-4093-83e7-f346a316b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.399184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542b35e832c847f7b98b98f0a9148800', 'request_id': 'req-7cbea998-2c57-4093-83e7-f346a316b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.439962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] The token cache is being invalidate because project 542b35e832c847f7b98b98f0a9148800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:01.440935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.443497 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7cbea998-2c57-4093-83e7-f346a316b8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:01.456865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1282/2537] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:01 2022] DELETE /identity/v3/projects/542b35e832c847f7b98b98f0a9148800 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:01.460011 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6f74-67a7-4676-a7c4-242fcd7d6090 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:01.461039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6f74-67a7-4676-a7c4-242fcd7d6090 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:01.461588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6f74-67a7-4676-a7c4-242fcd7d6090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:01.532777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-debf6f74-67a7-4676-a7c4-242fcd7d6090 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:01.536358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-debf6f74-67a7-4676-a7c4-242fcd7d6090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:01.804168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c743b-dfa1-41f7-ab19-6638d91f63d9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:01.804556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c743b-dfa1-41f7-ab19-6638d91f63d9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:01.805061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c743b-dfa1-41f7-ab19-6638d91f63d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:01.824687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1256/2538] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:01.852456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bd1c743b-dfa1-41f7-ab19-6638d91f63d9 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:01.854392 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bd1c743b-dfa1-41f7-ab19-6638d91f63d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:01.878643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1283/2539] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:01.888072 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf6f74-67a7-4676-a7c4-242fcd7d6090 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:01.904694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf6f74-67a7-4676-a7c4-242fcd7d6090 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:01.917387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:01.918133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:01.918423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:01.918706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:01.919422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:01.919783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:01.922138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:01.968626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1257/2540] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:01.978769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c743b-dfa1-41f7-ab19-6638d91f63d9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:01.993029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c743b-dfa1-41f7-ab19-6638d91f63d9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.010006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283eb81-5bf3-491a-9b5d-63b9533ef36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.010690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283eb81-5bf3-491a-9b5d-63b9533ef36f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.010972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283eb81-5bf3-491a-9b5d-63b9533ef36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.011273 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283eb81-5bf3-491a-9b5d-63b9533ef36f admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.012584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283eb81-5bf3-491a-9b5d-63b9533ef36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.019359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283eb81-5bf3-491a-9b5d-63b9533ef36f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.156789 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1284/2541] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:01 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:02.161016 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.178458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0008d03-a51f-4290-badf-75ebfd7c7da2 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.264024 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.266680 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.267095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.335734 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] MFA Rules not processed for user `4a389b840d504d3b84e87642cb137f98`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:02.338412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:02.407585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.408594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.409104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.409581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.411176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.413589 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.489326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1285/2542] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:02.493927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.495958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:02.519997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426803-4b22-4dd1-bf34-50fd548ff2fb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.537473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.538627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.540833 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.541872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.542861 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.549827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.558416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1258/2543] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:02 2022] POST /identity/v3/users => generated 286 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:02.561683 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.575968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2f27-18b2-4efc-810d-4ba99a8c3236 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.581698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.583156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.583413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.583725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.584627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.586525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.604475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1259/2544] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:02.605845 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.633266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888d1e7-c95e-4685-bd89-189eb452cdd3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.636025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.637009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.637506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.638001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.639557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.642423 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.662722 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1260/2545] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:02.670569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.682497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e533344-d2f5-4ab6-8d83-3afbd4eb4b72 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.688680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590acbc8-1283-47d4-bf16-b0b7d5d8b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.689471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590acbc8-1283-47d4-bf16-b0b7d5d8b905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.689921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590acbc8-1283-47d4-bf16-b0b7d5d8b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.690389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590acbc8-1283-47d4-bf16-b0b7d5d8b905 admin admin] PATH_INFO: `/v3/projects/c329349544cb43e4ba5d9a324f59529f/users/b4f57f9f99464d40a4641ed01d868d43/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.714846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1286/2546] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:02 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:02.715937 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590acbc8-1283-47d4-bf16-b0b7d5d8b905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c329349544cb43e4ba5d9a324f59529f, user_id=b4f57f9f99464d40a4641ed01d868d43, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.717424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.718946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590acbc8-1283-47d4-bf16-b0b7d5d8b905 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.823243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:02.826493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd952f-0f2f-4b08-a3b5-12b42d98593e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:02.829270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1261/2547] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:02 2022] PUT /identity/v3/projects/c329349544cb43e4ba5d9a324f59529f/users/b4f57f9f99464d40a4641ed01d868d43/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:02.843329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.843707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.846711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.894743 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] MFA Rules not processed for user `b4f57f9f99464d40a4641ed01d868d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:02.902206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:02.942787 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:02.943424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:02.943712 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:02.943992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:02.944674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:02.946849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:02.981826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1262/2548] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:02.994585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:02.996222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:03.064565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1287/2549] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:02 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:03.065065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dff2c-b4b3-4dd2-bf6d-a3c5ff695e20 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:03.068703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:03.070279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adb0143db64ca68f9c3846951adb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:03.071010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:03.071911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:03.072356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:03.082661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:03.084402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:03.094975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbd12b-840f-4169-b6ed-86296affc075 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:03.099915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1263/2550] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:03.116395 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:03.117044 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:03.117947 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:03.118359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:03.119881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:03.124475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:03.139975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1288/2551] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:25:03.144428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:03.155654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:03.160099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2224161-1707-4605-b0ca-aef32e8c54bd service glance] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:03.165655 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:03.166569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:03.166851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:03.167128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] PATH_INFO: `/v3/projects/9d6d84378813465d9bbc87eac754ecb1/users/1ce9d107680c4266907701e21a8c2d42/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:03.185759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6d84378813465d9bbc87eac754ecb1, user_id=1ce9d107680c4266907701e21a8c2d42, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:03.189090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:03.314888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1264/2552] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:03 2022] PUT /identity/v3/projects/9d6d84378813465d9bbc87eac754ecb1/users/1ce9d107680c4266907701e21a8c2d42/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:03.318795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:03.331795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41ed72-59ba-45d3-af9c-f37f3ced9f73 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:03.349123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:03.350989 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:03.506074 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:03.507545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:03.519166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:03.519455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:03.523870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:03.523870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:03.551388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1289/2553] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:03.554206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:03.579810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e09f52-131f-488d-a4de-d186edacfa99 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:03.600845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea0c8-3b34-4041-9af3-d8461f3790b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:03.600845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea0c8-3b34-4041-9af3-d8461f3790b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:03.600845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea0c8-3b34-4041-9af3-d8461f3790b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:03.600845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea0c8-3b34-4041-9af3-d8461f3790b5 admin admin] PATH_INFO: `/v3/projects/9d6d84378813465d9bbc87eac754ecb1/users/1ce9d107680c4266907701e21a8c2d42/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:03.601291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5359-4fb2-4395-bdc6-9cbde79187c7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:03.603205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea0c8-3b34-4041-9af3-d8461f3790b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6d84378813465d9bbc87eac754ecb1, user_id=1ce9d107680c4266907701e21a8c2d42, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:03.608427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea0c8-3b34-4041-9af3-d8461f3790b5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:03.613286 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:03.614045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:03.614531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:03.615173 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] PATH_INFO: `/v3/users/6f74cb8782384b2c910115585de6369c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:03.637334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f74cb8782384b2c910115585de6369c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:03.640552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:03.658958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1290/2554] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:03 2022] PUT /identity/v3/projects/9d6d84378813465d9bbc87eac754ecb1/users/1ce9d107680c4266907701e21a8c2d42/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:03.915759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:03.916042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:03.916318 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:03.948817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] MFA Rules not processed for user `db7e0e771edc4659b9f5d3d88aa65a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:03.950341 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:03.998881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f74cb8782384b2c910115585de6369c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:04.000197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f74cb8782384b2c910115585de6369c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:04.034348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f74cb8782384b2c910115585de6369c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:04.040352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1291/2555] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:04.041291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:04.042885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:04.125530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89016-3c20-40ec-b959-e2109a00fbd0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:04.132929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:04.133907 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:04.134524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:04.135060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:04.135808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:04.137968 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:04.149631 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f74cb8782384b2c910115585de6369c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:04.153197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ad4ace23-d322-4329-8372-ad381c56c2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f74cb8782384b2c910115585de6369c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:04.197550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1265/2556] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:03 2022] DELETE /identity/v3/users/6f74cb8782384b2c910115585de6369c => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:04.203397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:04.204216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:04.204671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:04.250089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:04.252181 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:04.256309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1292/2557] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:04 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:04.259855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:04.264592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:04.390262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1266/2558] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:04.403230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:04.404865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:04.451173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f122-b879-4307-8cf4-d1ad526a435d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:04.457092 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:04.457863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:04.459067 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:04.459694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:04.460671 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:04.463239 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:04.532274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1d9bc-c616-45da-879c-b2663d54dc75 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:04.538195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:04.538904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:04.539249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:04.539586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:04.589244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:04.608054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:04.610890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1293/2559] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:04 2022] POST /identity/v3/users => generated 299 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:04.612627 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:04.622137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:04.647194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1267/2560] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:04.648897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:04.663186 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f032f-a567-4fd4-8f88-579382cafe18 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:04.679737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0057-5d47-4699-90ab-6e0e156ee0e7 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:04.681116 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:04.682595 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:04.683255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:04.683891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] PATH_INFO: `/v3/users/bdbec54572cd419db1a283a72ea5a1c4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:04.687398 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdbec54572cd419db1a283a72ea5a1c4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:04.694510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:04.704799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:04.706162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:04.708546 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:04.709192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:04.716995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:04.721135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:04.756896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1268/2561] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:04.762353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:04.780895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f033fd-add1-4417-9318-8142a3114143 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:04.792412 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:04.793772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:04.794264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:04.794797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] PATH_INFO: `/v3/projects/f7865cce9ad244728822c1ff3e443f4e/users/062ff1f276dd4d84910667b282ff3991/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:04.821854 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7865cce9ad244728822c1ff3e443f4e, user_id=062ff1f276dd4d84910667b282ff3991, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:04.826303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:04.886749 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:04.980677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1269/2562] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:04 2022] PUT /identity/v3/projects/f7865cce9ad244728822c1ff3e443f4e/users/062ff1f276dd4d84910667b282ff3991/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:04.993759 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:05.030873 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdbec54572cd419db1a283a72ea5a1c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:05.036501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdbec54572cd419db1a283a72ea5a1c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:05.100447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdbec54572cd419db1a283a72ea5a1c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:05.145832 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdbec54572cd419db1a283a72ea5a1c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:05.246885 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdbec54572cd419db1a283a72ea5a1c4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:05.257058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1294/2563] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:04 2022] DELETE /identity/v3/users/bdbec54572cd419db1a283a72ea5a1c4 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:05.264289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ddf8-d743-4814-ad75-c53f6f1e9839 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:05.337624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:05.387448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:05.388363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:05.388363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:05.388695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:05.390275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:05.397242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:05.439008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1270/2564] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:25:05.443736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:05.443736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:05.474858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7bb1f-5b20-4e1b-920a-507f23053573 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:05.500069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:05.500939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:05.503755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:05.510742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] PATH_INFO: `/v3/projects/f7865cce9ad244728822c1ff3e443f4e/users/062ff1f276dd4d84910667b282ff3991/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:05.513143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7865cce9ad244728822c1ff3e443f4e, user_id=062ff1f276dd4d84910667b282ff3991, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:05.521229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:05.549413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1295/2565] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:05 2022] PUT /identity/v3/projects/f7865cce9ad244728822c1ff3e443f4e/users/062ff1f276dd4d84910667b282ff3991/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:05.783142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:05.786200 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:05.825659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0696a-0ecd-4069-b0e5-dc6a8c8d795f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:05.848599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:05.852391 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:06.022281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:06.022990 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:06.023285 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:06.026377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1113-d359-4c2e-af60-e18dcb3308d5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:06.027656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] PATH_INFO: `/v3/projects/196d520e00a54b51a3fe693803ff3546` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:06.032771 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196d520e00a54b51a3fe693803ff3546)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:06.039321 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:06.039681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:06.041109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:06.041109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:06.041109 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] PATH_INFO: `/v3/projects/3d8f110e13f3451091ed5510c9a3fdeb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:06.044086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8f110e13f3451091ed5510c9a3fdeb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:06.046377 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:06.244603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8f110e13f3451091ed5510c9a3fdeb', 'request_id': 'req-a6232fef-9603-4585-9824-fc69bbe22d20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.254822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8f110e13f3451091ed5510c9a3fdeb', 'request_id': 'req-a6232fef-9603-4585-9824-fc69bbe22d20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.261848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196d520e00a54b51a3fe693803ff3546', 'request_id': 'req-607f87a9-e2f1-46b5-94d2-473540f0ab13'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.276529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196d520e00a54b51a3fe693803ff3546', 'request_id': 'req-607f87a9-e2f1-46b5-94d2-473540f0ab13'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.295266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196d520e00a54b51a3fe693803ff3546', 'request_id': 'req-607f87a9-e2f1-46b5-94d2-473540f0ab13'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.331659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8f110e13f3451091ed5510c9a3fdeb', 'request_id': 'req-a6232fef-9603-4585-9824-fc69bbe22d20'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.351224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] The token cache is being invalidate because project 3d8f110e13f3451091ed5510c9a3fdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:06.352510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.353490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.358499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1296/2566] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:05 2022] DELETE /identity/v3/projects/3d8f110e13f3451091ed5510c9a3fdeb => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:06.366408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:06.371783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:06.440694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] The token cache is being invalidate because project 196d520e00a54b51a3fe693803ff3546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:06.441049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.442515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.444632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1271/2567] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:05 2022] DELETE /identity/v3/projects/196d520e00a54b51a3fe693803ff3546 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:06.448499 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:06.450014 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:06.505233 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232fef-9603-4585-9824-fc69bbe22d20 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:06.605417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f87a9-e2f1-46b5-94d2-473540f0ab13 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:06.619706 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:06.620993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:06.620993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:06.621203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] PATH_INFO: `/v3/users/16d5a475cdab49e09190dac08634ea8e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:06.622651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d5a475cdab49e09190dac08634ea8e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:06.623597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:06.624428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:06.624582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:06.625006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:06.625510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] PATH_INFO: `/v3/users/603cc234019144e99ca7fb74cc87a0ef` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:06.627670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=603cc234019144e99ca7fb74cc87a0ef)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:06.630337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:06.739221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:06.889950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d5a475cdab49e09190dac08634ea8e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.890726 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d5a475cdab49e09190dac08634ea8e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.930222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d5a475cdab49e09190dac08634ea8e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.930821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603cc234019144e99ca7fb74cc87a0ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.934790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603cc234019144e99ca7fb74cc87a0ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.967050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603cc234019144e99ca7fb74cc87a0ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:06.977003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603cc234019144e99ca7fb74cc87a0ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:07.063919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d5a475cdab49e09190dac08634ea8e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:07.065769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d5a475cdab49e09190dac08634ea8e'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:07.115404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1272/2568] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:06 2022] DELETE /identity/v3/users/16d5a475cdab49e09190dac08634ea8e => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:07.148820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca5eafb4-3e16-49f5-ab81-6e3938031d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603cc234019144e99ca7fb74cc87a0ef'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:07.155384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1297/2569] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:06 2022] DELETE /identity/v3/users/603cc234019144e99ca7fb74cc87a0ef => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:07.612254 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:07.752125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:07.753862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:07.896622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78910ee-b468-478e-9349-4952b34430dc admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:08.018500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:08.019415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:08.019808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:08.020190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] PATH_INFO: `/v3/projects/339211eaa93346f9b28e87790df038ce` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:08.023773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339211eaa93346f9b28e87790df038ce)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:08.026558 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:08.228577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339211eaa93346f9b28e87790df038ce', 'request_id': 'req-bce2a0eb-df2d-45e9-8370-0f9815124180'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:08.288453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339211eaa93346f9b28e87790df038ce', 'request_id': 'req-bce2a0eb-df2d-45e9-8370-0f9815124180'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:08.299090 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339211eaa93346f9b28e87790df038ce', 'request_id': 'req-bce2a0eb-df2d-45e9-8370-0f9815124180'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:08.409396 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] The token cache is being invalidate because project 339211eaa93346f9b28e87790df038ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:08.409616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:08.410374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bce2a0eb-df2d-45e9-8370-0f9815124180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:08.412687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1273/2570] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:07 2022] DELETE /identity/v3/projects/339211eaa93346f9b28e87790df038ce => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:08.423388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325b4c-f838-4687-93ff-106f44722c51 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:08.423388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325b4c-f838-4687-93ff-106f44722c51 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:08.423388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325b4c-f838-4687-93ff-106f44722c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:08.497624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f7325b4c-f838-4687-93ff-106f44722c51 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:08.498963 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7325b4c-f838-4687-93ff-106f44722c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:08.650852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1298/2571] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:08.659288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4f1f2-9d15-4c62-8e7b-0794daf4fab7 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:08.659587 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4f1f2-9d15-4c62-8e7b-0794daf4fab7 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:08.664353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4f1f2-9d15-4c62-8e7b-0794daf4fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:08.682483 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-32d4f1f2-9d15-4c62-8e7b-0794daf4fab7 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:08.683926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-32d4f1f2-9d15-4c62-8e7b-0794daf4fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:08.694384 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1274/2572] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:08.698277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7325b4c-f838-4687-93ff-106f44722c51 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:08.713184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7325b4c-f838-4687-93ff-106f44722c51 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:08.726678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:08.727683 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:08.728237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:08.728740 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:08.729650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:08.730427 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:08.732340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:08.752242 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:08.755770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1299/2573] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:08.760120 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4f1f2-9d15-4c62-8e7b-0794daf4fab7 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:08.773308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4f1f2-9d15-4c62-8e7b-0794daf4fab7 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:08.783271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:08.784714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:08.784714 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:08.785087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:08.786019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:08.788891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:08.944189 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:08.949184 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:08.954380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1275/2574] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:08 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:08.960303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:08.976371 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0807d3-c699-42b3-acdd-364e16ae5a58 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:09.138207 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7db65-05ae-475c-ade0-f961307e17f7 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:09.147323 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:09.148532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.149475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.150432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.152999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:09.156411 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:09.161852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:09.162791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.163482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.163763 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] PATH_INFO: `/v3/projects/bba877ee31014d65a7d6e96fe523613d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.173976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba877ee31014d65a7d6e96fe523613d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:09.176350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:09.264725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1276/2575] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:08 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:09.269399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:09.291192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d330ba5-7cf8-4a4c-8136-466896180ec0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:09.333312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:09.333312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.333312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.333841 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.334697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:09.336415 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:09.363914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba877ee31014d65a7d6e96fe523613d', 'request_id': 'req-41c03bbf-25be-44e9-bcbb-f00ac288826f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:09.365453 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1277/2576] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:25:09.374169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:09.385521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba877ee31014d65a7d6e96fe523613d', 'request_id': 'req-41c03bbf-25be-44e9-bcbb-f00ac288826f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:09.406408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3eb8-d14f-4b19-921c-d0cf1ed8ca6e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:09.446359 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba877ee31014d65a7d6e96fe523613d', 'request_id': 'req-41c03bbf-25be-44e9-bcbb-f00ac288826f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:09.474306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] The token cache is being invalidate because project bba877ee31014d65a7d6e96fe523613d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:09.475941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:09.477374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-41c03bbf-25be-44e9-bcbb-f00ac288826f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:09.489776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1300/2577] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:08 2022] DELETE /identity/v3/projects/bba877ee31014d65a7d6e96fe523613d => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:09.491334 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9c692-b20f-4a35-9105-8bd02104665f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.493878 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9c692-b20f-4a35-9105-8bd02104665f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.494217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9c692-b20f-4a35-9105-8bd02104665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.577146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fca9c692-b20f-4a35-9105-8bd02104665f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:09.580877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fca9c692-b20f-4a35-9105-8bd02104665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:09.588146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:09.588808 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.589521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.589521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.595121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:09.601341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:09.618886 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1301/2578] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:09.631742 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e873ce-ba7e-4e26-a346-3c288b9f2704 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.636682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1278/2579] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:09.636902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e873ce-ba7e-4e26-a346-3c288b9f2704 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.636902 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e873ce-ba7e-4e26-a346-3c288b9f2704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.648408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:09.650380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:09.690569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5cf1-8f29-457b-9f06-f6d2a8d0579d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:09.712203 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf190a48-3a86-4ff8-88e8-8392e1f451ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:09.713094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf190a48-3a86-4ff8-88e8-8392e1f451ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.713310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf190a48-3a86-4ff8-88e8-8392e1f451ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.713596 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf190a48-3a86-4ff8-88e8-8392e1f451ff admin admin] PATH_INFO: `/v3/projects/88edc131af1c4433a6089e2e5117cec8/users/8cdc64ddec6241d39d677affcf7ee517/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.714518 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c9e873ce-ba7e-4e26-a346-3c288b9f2704 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:09.719032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c9e873ce-ba7e-4e26-a346-3c288b9f2704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:09.747943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1302/2580] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:09.751143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e873ce-ba7e-4e26-a346-3c288b9f2704 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:09.776597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e873ce-ba7e-4e26-a346-3c288b9f2704 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:09.783067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf190a48-3a86-4ff8-88e8-8392e1f451ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=88edc131af1c4433a6089e2e5117cec8, user_id=8cdc64ddec6241d39d677affcf7ee517, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:09.802693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf190a48-3a86-4ff8-88e8-8392e1f451ff admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:09.804424 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:09.805439 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.805865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.806220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.807187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:09.807584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:09.811872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:09.860584 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1303/2581] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:09.864998 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:09.884863 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b58a-1439-4d1d-968b-c9a5d5d9f31f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:09.910112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:09.911056 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:09.911505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:09.911949 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:09.926062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:09.934146 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:10.097963 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1279/2582] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:09 2022] PUT /identity/v3/projects/88edc131af1c4433a6089e2e5117cec8/users/8cdc64ddec6241d39d677affcf7ee517/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:10.112842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad1f0-8d52-4f17-b1cd-c23c5dd6b484 None None] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.113245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad1f0-8d52-4f17-b1cd-c23c5dd6b484 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.113747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad1f0-8d52-4f17-b1cd-c23c5dd6b484 None None] PATH_INFO: `/` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.115309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1280/2583] 10.222.0.71 () {54 vars in 921 bytes} [Tue Aug 2 09:25:10 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:25:10.116441 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f201-9907-42e0-95e1-5e19905a29ff None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.117227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f201-9907-42e0-95e1-5e19905a29ff None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.117608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f201-9907-42e0-95e1-5e19905a29ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.145336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1304/2584] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:09 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:10.146605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:10.196975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-39a6f201-9907-42e0-95e1-5e19905a29ff None None] MFA Rules not processed for user `8cdc64ddec6241d39d677affcf7ee517`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:10.198218 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-39a6f201-9907-42e0-95e1-5e19905a29ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:10.318651 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34850-c30e-46a6-aebc-47bad08c7651 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:10.336011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:10.336672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.336958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.337309 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.342750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:10.349185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:10.353276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1281/2585] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:10.354408 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1eb12-47e8-4626-9256-91c1b127c310 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.354699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1eb12-47e8-4626-9256-91c1b127c310 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.354986 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1eb12-47e8-4626-9256-91c1b127c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.399331 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f0f1eb12-47e8-4626-9256-91c1b127c310 None None] MFA Rules not processed for user `8771927999ea4471a4673dead83336e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:10.400030 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f0f1eb12-47e8-4626-9256-91c1b127c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:10.541416 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1305/2586] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:10 2022] POST /identity/v3/users => generated 289 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:10.542786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:10.549519 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1282/2587] 10.222.0.71 () {58 vars in 1018 bytes} [Tue Aug 2 09:25:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:10.550604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1eb12-47e8-4626-9256-91c1b127c310 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:10.552939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:10.563783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1eb12-47e8-4626-9256-91c1b127c310 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:10.581747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:10.581747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.581747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.581747 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.582311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:10.582311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:10.621020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1283/2588] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:10.633653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:10.679014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:10.680159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cee7-79fc-4396-a5a4-07ed08cf7d5f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:10.715347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:10.715347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.715347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.715347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.715762 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:10.721867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:10.773844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1284/2589] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:10.773844 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:10.780908 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:10.784106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5d592-2ae7-420c-8f8e-5f67376e13b2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:10.809040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adb0143db64ca68f9c3846951adb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:10.809709 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.810022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.810343 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.845077 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:10.846594 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:10.848652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d21f52-9cbb-4e7b-8306-168470164f94 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:10.864981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ab53a-6573-41e8-a7a4-e71657f6f105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:10.869868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab53a-6573-41e8-a7a4-e71657f6f105 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.870641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab53a-6573-41e8-a7a4-e71657f6f105 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.877271 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab53a-6573-41e8-a7a4-e71657f6f105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.879994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1306/2590] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:10.887269 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:10.927468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eca803-9d24-4815-ad4a-fe8f29f14711 service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:10.928237 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ab53a-6573-41e8-a7a4-e71657f6f105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:10.929896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ab53a-6573-41e8-a7a4-e71657f6f105 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:10.957616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:10.965493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:10.965493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:10.965493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] PATH_INFO: `/v3/projects/cfa61264acdf498e9da5bef6ca62fff0/users/b8ca1335caf0488e89204334019e7cb5/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:10.982465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1285/2591] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:11.031748 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa61264acdf498e9da5bef6ca62fff0, user_id=b8ca1335caf0488e89204334019e7cb5, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:11.034539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:11.138729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1307/2592] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:10 2022] PUT /identity/v3/projects/cfa61264acdf498e9da5bef6ca62fff0/users/b8ca1335caf0488e89204334019e7cb5/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:11.150180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe996a-dad3-4573-b04b-dd1fdd6a7f0e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:11.150462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe996a-dad3-4573-b04b-dd1fdd6a7f0e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:11.150741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe996a-dad3-4573-b04b-dd1fdd6a7f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:11.222663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-defe996a-dad3-4573-b04b-dd1fdd6a7f0e None None] MFA Rules not processed for user `b8ca1335caf0488e89204334019e7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:11.223942 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-defe996a-dad3-4573-b04b-dd1fdd6a7f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:11.478700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:11.478948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1286/2593] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:11.587950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:11.613174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead81c2b-1814-4404-b565-fbc36e9777ac admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:11.634714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:11.635370 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:11.637145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:11.637432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:11.638165 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:11.668919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:11.805007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1308/2594] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:11 2022] POST /identity/v3/projects => generated 379 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:11.808896 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe996a-dad3-4573-b04b-dd1fdd6a7f0e None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:11.839997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe996a-dad3-4573-b04b-dd1fdd6a7f0e None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:11.963521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:11.965001 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:11.965465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:11.966055 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:11.967310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:11.974501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:12.071903 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1287/2595] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:11 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:12.076901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:12.088685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442f9e-69b5-44d4-abce-39239bf693f8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:12.098305 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:12.099346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:12.101420 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:12.101732 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:12.102640 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:12.111736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:12.132190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1309/2596] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:12.136301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:12.169488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f641892-ae18-45b7-ba89-c069269e642e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:12.202702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:12.204725 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:12.205313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:12.205799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] PATH_INFO: `/v3/projects/8866198a2f6140f089bd464f11c5c94f/users/8bc7540374414ee9bc0911def664e1ea/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:12.226425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8866198a2f6140f089bd464f11c5c94f, user_id=8bc7540374414ee9bc0911def664e1ea, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:12.229482 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:12.290216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:12.355012 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1288/2597] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:12 2022] PUT /identity/v3/projects/8866198a2f6140f089bd464f11c5c94f/users/8bc7540374414ee9bc0911def664e1ea/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:12.359259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:12.399162 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f26e2-7983-4075-a1d9-ee5f04a3e63d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:12.570778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f064c3-6347-4dfc-afbf-e7b238ce7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:12.571443 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f064c3-6347-4dfc-afbf-e7b238ce7a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:12.571733 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f064c3-6347-4dfc-afbf-e7b238ce7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:12.572015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f064c3-6347-4dfc-afbf-e7b238ce7a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:12.572928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f064c3-6347-4dfc-afbf-e7b238ce7a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:12.574989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f064c3-6347-4dfc-afbf-e7b238ce7a2e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:12.601440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1310/2598] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:12.605674 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:12.622403 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb89153-6bed-4b6a-a273-befe01d9e169 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:12.628987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:12.632648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:12.632648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:12.632648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] PATH_INFO: `/v3/projects/8866198a2f6140f089bd464f11c5c94f/users/8bc7540374414ee9bc0911def664e1ea/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:12.633393 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8866198a2f6140f089bd464f11c5c94f, user_id=8bc7540374414ee9bc0911def664e1ea, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:12.636699 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:12.649369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1289/2599] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:12 2022] PUT /identity/v3/projects/8866198a2f6140f089bd464f11c5c94f/users/8bc7540374414ee9bc0911def664e1ea/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:12.660553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2acf0-f53c-4d25-b335-403701e3fee8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:12.665241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2acf0-f53c-4d25-b335-403701e3fee8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:12.665241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2acf0-f53c-4d25-b335-403701e3fee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:12.717331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-02c2acf0-f53c-4d25-b335-403701e3fee8 None None] MFA Rules not processed for user `8bc7540374414ee9bc0911def664e1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:12.719824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-02c2acf0-f53c-4d25-b335-403701e3fee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:12.857250 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1311/2600] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:12.872641 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:12.875144 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:13.097996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426af7f2-f71e-4e39-919a-bb90555ac55e admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:13.105517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:13.106217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:13.106504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:13.106785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:13.237454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:13.239663 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:13.255328 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1290/2601] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:13.361777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:15.191152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:15.191152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:15.191152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:15.225225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:15.260823 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] MFA Rules not processed for user `1ce9d107680c4266907701e21a8c2d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:15.264041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:15.404766 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1312/2602] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:15.419972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:15.423561 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:15.544765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353bc22-f27d-4495-ac87-7ff597e8b199 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:15.552565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad689d-fd6e-465b-a0fd-1e63c0096bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771927999ea4471a4673dead83336e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:15.553333 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad689d-fd6e-465b-a0fd-1e63c0096bf2 service nova] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:15.553775 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad689d-fd6e-465b-a0fd-1e63c0096bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:15.554279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad689d-fd6e-465b-a0fd-1e63c0096bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:15.557680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-18ad689d-fd6e-465b-a0fd-1e63c0096bf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:15.726736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad689d-fd6e-465b-a0fd-1e63c0096bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:15.728887 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad689d-fd6e-465b-a0fd-1e63c0096bf2 service nova] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:15.767892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1291/2603] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:15.855925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:16.060698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:16.061354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:16.101088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50127-bc47-4d06-bee2-c704a156fabe None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:16.110388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:16.111803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:16.112095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:16.112437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:16.127808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:16.131958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:16.154781 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1313/2604] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:16.569820 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c1227-7075-4149-8481-d22895fb1f5d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:16.570338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c1227-7075-4149-8481-d22895fb1f5d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:16.570661 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c1227-7075-4149-8481-d22895fb1f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:16.639209 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-1e4c1227-7075-4149-8481-d22895fb1f5d None None] MFA Rules not processed for user `062ff1f276dd4d84910667b282ff3991`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:16.640489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1e4c1227-7075-4149-8481-d22895fb1f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:16.762957 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1292/2605] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:18.091827 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:18.093258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:18.152217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de4cc7-0fa6-4693-bd70-c4a0fc232dcd service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:18.157367 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adb0143db64ca68f9c3846951adb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:18.158393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:18.158663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:18.158935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:18.160845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:18.229030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:18.230524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:18.240222 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1314/2606] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:18.617814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:18.741874 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245d7f-382c-426d-ab27-a18df00a9667 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:18.743161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245d7f-382c-426d-ab27-a18df00a9667 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:18.743873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245d7f-382c-426d-ab27-a18df00a9667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:18.776343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-a0245d7f-382c-426d-ab27-a18df00a9667 None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:18.778344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a0245d7f-382c-426d-ab27-a18df00a9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:18.795638 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:18.858865 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1293/2607] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:25:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:18.889091 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:18.890779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:18.987205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dfd52-2419-49ac-b54d-cf9d03af3556 service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:18.993841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:18.994477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:18.994767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:18.995049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:19.005015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:19.006670 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:19.017542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1315/2608] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:25:19.827609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025cd1-cafc-41ca-b5d6-ce1838fb812e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:19.829095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025cd1-cafc-41ca-b5d6-ce1838fb812e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:19.830211 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025cd1-cafc-41ca-b5d6-ce1838fb812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:19.885402 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d2025cd1-cafc-41ca-b5d6-ce1838fb812e None None] MFA Rules not processed for user `4a389b840d504d3b84e87642cb137f98`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:19.886881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d2025cd1-cafc-41ca-b5d6-ce1838fb812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:19.909313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1294/2609] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:21.403860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:21.456853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:21.571830 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925a934-a3fe-4fbf-b5a5-148e27d54785 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:21.583873 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:21.585964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:21.586707 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:21.587214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:21.587674 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] PATH_INFO: `/v3/users/b8ca1335caf0488e89204334019e7cb5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:21.590148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ca1335caf0488e89204334019e7cb5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:21.595278 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:21.835976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ca1335caf0488e89204334019e7cb5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:21.837173 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ca1335caf0488e89204334019e7cb5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:21.920417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ca1335caf0488e89204334019e7cb5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:21.932332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ca1335caf0488e89204334019e7cb5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:22.031374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ca1335caf0488e89204334019e7cb5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:22.044883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1316/2610] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:21 2022] DELETE /identity/v3/users/b8ca1335caf0488e89204334019e7cb5 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:22.046444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:22.046729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:22.047065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:22.069769 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:22.071366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:22.176824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1295/2611] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:22.186124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:22.187778 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:22.316761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8954057-105e-4be0-9507-788ad399592d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:22.327620 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:22.328267 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:22.329236 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:22.330053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:22.354457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:22.370072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:22.410373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1317/2612] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:22.955022 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:22.956480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:22.991593 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9073887-6923-4a6c-96b4-c9d6884aaefd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:22.996268 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:22.997302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:22.997785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:22.998257 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] PATH_INFO: `/v3/users/6c284a01207b423799642935e6d355f7` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:23.000010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c284a01207b423799642935e6d355f7)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:23.003565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:23.303011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:23.303011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:23.319604 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2987c-6e15-4a69-b160-be02fd80ef0b service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:23.326621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:23.327456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:23.327957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:23.328243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] PATH_INFO: `/v3/projects/cfa61264acdf498e9da5bef6ca62fff0` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:23.329576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa61264acdf498e9da5bef6ca62fff0)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:23.331867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:23.380950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c284a01207b423799642935e6d355f7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.381670 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c284a01207b423799642935e6d355f7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.395870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c284a01207b423799642935e6d355f7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.453147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa61264acdf498e9da5bef6ca62fff0', 'request_id': 'req-54ab5c43-1140-409b-89e4-816d1a4f22c2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.461540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa61264acdf498e9da5bef6ca62fff0', 'request_id': 'req-54ab5c43-1140-409b-89e4-816d1a4f22c2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.534997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c284a01207b423799642935e6d355f7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.534997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-05d073b3-3b05-4ccd-ac06-8e673b733be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c284a01207b423799642935e6d355f7'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.554166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1296/2613] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:22 2022] DELETE /identity/v3/users/6c284a01207b423799642935e6d355f7 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:23.558053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:23.558480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:23.569362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:23.585163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:23.586677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:23.650033 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa61264acdf498e9da5bef6ca62fff0', 'request_id': 'req-54ab5c43-1140-409b-89e4-816d1a4f22c2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.661553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] The token cache is being invalidate because project cfa61264acdf498e9da5bef6ca62fff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:23.661970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.662796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:23.664489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1318/2614] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:23 2022] DELETE /identity/v3/projects/cfa61264acdf498e9da5bef6ca62fff0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:23.668775 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:23.671069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:23.689915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1297/2615] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:23.698882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:23.700733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:23.798703 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5c43-1140-409b-89e4-816d1a4f22c2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:23.808554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:23.809546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:23.810921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:23.811552 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] PATH_INFO: `/v3/users/8bc7540374414ee9bc0911def664e1ea` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:23.816003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc7540374414ee9bc0911def664e1ea)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:23.818522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:23.831127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:23.881262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ad09b-5a0e-41fb-8e94-76d3d0390065 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:23.888547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:23.890121 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:23.890599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:23.891610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:23.903192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:23.904660 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:23.920673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1298/2616] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:23.989135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:24.149819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc7540374414ee9bc0911def664e1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:24.150845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc7540374414ee9bc0911def664e1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:24.166143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc7540374414ee9bc0911def664e1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:24.175939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc7540374414ee9bc0911def664e1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:24.239914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d15fe528-1392-4d76-9d32-53059a9ca5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc7540374414ee9bc0911def664e1ea'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:24.260653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1319/2617] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:23 2022] DELETE /identity/v3/users/8bc7540374414ee9bc0911def664e1ea => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:24.564227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:24.566600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:24.606430 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6cdaf-91ca-4f0a-ac7b-63b2d1f5cb07 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:24.774877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:24.779080 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:24.781460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:24.781460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] PATH_INFO: `/v3/projects/0b3ef7814ea345c2a233b7653828e2b3` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:24.790754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3ef7814ea345c2a233b7653828e2b3)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:24.797064 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:24.985909 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3ef7814ea345c2a233b7653828e2b3', 'request_id': 'req-ed5447de-a068-4972-ab01-0c01a9b2265d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:24.995210 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3ef7814ea345c2a233b7653828e2b3', 'request_id': 'req-ed5447de-a068-4972-ab01-0c01a9b2265d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.005584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3ef7814ea345c2a233b7653828e2b3', 'request_id': 'req-ed5447de-a068-4972-ab01-0c01a9b2265d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.086606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] The token cache is being invalidate because project 0b3ef7814ea345c2a233b7653828e2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:25.086911 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.087697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.091992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1299/2618] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:24 2022] DELETE /identity/v3/projects/0b3ef7814ea345c2a233b7653828e2b3 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:25.096737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1079-30b7-422f-a102-f6f8da557148 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.097242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1079-30b7-422f-a102-f6f8da557148 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.097346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1079-30b7-422f-a102-f6f8da557148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.122521 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-203c1079-30b7-422f-a102-f6f8da557148 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:25.123912 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-203c1079-30b7-422f-a102-f6f8da557148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:25.200773 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.208138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:25.231643 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1320/2619] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:25.236899 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5447de-a068-4972-ab01-0c01a9b2265d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.237052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76500-37f6-488f-8d78-185af81bf96b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.237052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76500-37f6-488f-8d78-185af81bf96b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.237052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76500-37f6-488f-8d78-185af81bf96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.247662 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.248367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.248657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.248939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] PATH_INFO: `/v3/projects/8866198a2f6140f089bd464f11c5c94f` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.254621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8866198a2f6140f089bd464f11c5c94f)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.256574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.274012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e8e76500-37f6-488f-8d78-185af81bf96b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:25.275384 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e8e76500-37f6-488f-8d78-185af81bf96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:25.290649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1321/2620] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:25.297689 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76500-37f6-488f-8d78-185af81bf96b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.311919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76500-37f6-488f-8d78-185af81bf96b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.318612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.319565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.320083 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.320542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.322034 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:25.322556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.324442 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.348507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1322/2621] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:25.352498 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.363467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:25.369889 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e1c8e-ff01-4f52-952f-616ea11657db admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.378993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.380211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.380625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.381064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.381929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.384554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.460428 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8866198a2f6140f089bd464f11c5c94f', 'request_id': 'req-b539389c-8e01-40ab-9b78-a34275e2c842'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.473040 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8866198a2f6140f089bd464f11c5c94f', 'request_id': 'req-b539389c-8e01-40ab-9b78-a34275e2c842'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.479936 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8866198a2f6140f089bd464f11c5c94f', 'request_id': 'req-b539389c-8e01-40ab-9b78-a34275e2c842'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.523583 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1323/2622] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/projects => generated 363 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:25.527530 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.605768 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] The token cache is being invalidate because project 8866198a2f6140f089bd464f11c5c94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:25.606399 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.607311 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b539389c-8e01-40ab-9b78-a34275e2c842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:25.609485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1300/2623] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:25 2022] DELETE /identity/v3/projects/8866198a2f6140f089bd464f11c5c94f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:25.612093 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:25.614547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5f8d-5a23-4256-8859-d6060f21987e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.615092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5f8d-5a23-4256-8859-d6060f21987e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.615533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5f8d-5a23-4256-8859-d6060f21987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.629943 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3b2f3-7b9e-4fa4-a75d-d2ec55ba159c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.637580 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.638306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.638745 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.646317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.646317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.646526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-d98f5f8d-5a23-4256-8859-d6060f21987e None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:25.646526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-d98f5f8d-5a23-4256-8859-d6060f21987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:25.646691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.654639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1301/2624] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:25.663881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02ce1-afcb-4be8-a948-98728f48cce1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.664078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02ce1-afcb-4be8-a948-98728f48cce1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.664363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02ce1-afcb-4be8-a948-98728f48cce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.689639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-03e02ce1-afcb-4be8-a948-98728f48cce1 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:25.691028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-03e02ce1-afcb-4be8-a948-98728f48cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:25.702162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1302/2625] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:25.706528 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02ce1-afcb-4be8-a948-98728f48cce1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.716812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02ce1-afcb-4be8-a948-98728f48cce1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.725291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.726316 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.726799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.727269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.728161 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:25.728629 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.730447 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.744939 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1303/2626] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:25:25.756481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.767264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0b3c-f830-4c5f-8b39-d83ad6058178 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.777194 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.784128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.784128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.784128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.784128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.784128 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.812380 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1324/2627] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/users => generated 282 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:25.821286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.823295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:25.837139 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8f7c5-10e2-453f-914b-a718f1314ff5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.842488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.848492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.848492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.848492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.848492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.848492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.857493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1325/2628] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:25.862774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.876993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e605f-89cb-451f-88cd-f3f311aec311 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.886127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:25.886127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:25.886127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:25.886127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:25.889592 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:25.891560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:25.910629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1326/2629] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:25.911814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:25.927068 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124267-4507-4a4f-9e4a-de878a8197ef admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:25.930337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1304/2630] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:25.932151 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.033924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532b40-fd09-4196-8399-29734add49fd admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:26.040791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52435-7194-4937-919a-a3d7df0d032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.041574 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52435-7194-4937-919a-a3d7df0d032b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.041980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52435-7194-4937-919a-a3d7df0d032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.042335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52435-7194-4937-919a-a3d7df0d032b admin admin] PATH_INFO: `/v3/projects/9a94852dc9c741c884ba48057f24c04d/users/1f8bdb76b8574a6fbcb4d05e3b21a522/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.045069 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.045960 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.046538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.046987 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.048245 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:26.050427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:26.064918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d52435-7194-4937-919a-a3d7df0d032b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a94852dc9c741c884ba48057f24c04d, user_id=1f8bdb76b8574a6fbcb4d05e3b21a522, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:26.068143 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d52435-7194-4937-919a-a3d7df0d032b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:26.155450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1305/2631] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:25 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:26.160382 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.170976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ba8d-f365-45e3-a4a0-05f01ee82402 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:26.182459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.182459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.182459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.182459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.183343 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:26.187390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:26.197021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1327/2632] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:25 2022] PUT /identity/v3/projects/9a94852dc9c741c884ba48057f24c04d/users/1f8bdb76b8574a6fbcb4d05e3b21a522/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:26.199919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2bdd1-5424-4264-bfa3-8dacf4b52ed1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.200513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2bdd1-5424-4264-bfa3-8dacf4b52ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.201027 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2bdd1-5424-4264-bfa3-8dacf4b52ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.209673 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1306/2633] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:25:26.215091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.236187 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846b159-2bb9-403f-b4a5-44c864deb130 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:26.252767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-52a2bdd1-5424-4264-bfa3-8dacf4b52ed1 None None] MFA Rules not processed for user `1f8bdb76b8574a6fbcb4d05e3b21a522`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:26.256399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-52a2bdd1-5424-4264-bfa3-8dacf4b52ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:26.323606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.324246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.324527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.324882 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.325656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:26.331067 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:26.359060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1328/2634] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:26.361851 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1307/2635] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:26.376010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.377214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2bdd1-5424-4264-bfa3-8dacf4b52ed1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.380656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:26.400266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2bdd1-5424-4264-bfa3-8dacf4b52ed1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:26.412251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb23b49-74da-4099-b202-6e02bbda8aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.413101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb23b49-74da-4099-b202-6e02bbda8aef admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.413548 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb23b49-74da-4099-b202-6e02bbda8aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.413865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb23b49-74da-4099-b202-6e02bbda8aef admin admin] PATH_INFO: `/v3/projects/d8a7e094ef9e45ddaf4c3a592699b94e/users/3bcad4e827164cf3a12d3dd6859eb853/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.447693 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb23b49-74da-4099-b202-6e02bbda8aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a7e094ef9e45ddaf4c3a592699b94e, user_id=3bcad4e827164cf3a12d3dd6859eb853, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:26.450608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb23b49-74da-4099-b202-6e02bbda8aef admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:26.486984 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3843c-c1fa-4676-8f61-e68e858451e1 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:26.491089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdf954-0bca-40a8-8d41-a216670d3ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.491717 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdf954-0bca-40a8-8d41-a216670d3ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.492005 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdf954-0bca-40a8-8d41-a216670d3ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.492282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdf954-0bca-40a8-8d41-a216670d3ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.504619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdf954-0bca-40a8-8d41-a216670d3ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:26.504619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdf954-0bca-40a8-8d41-a216670d3ec0 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:26.518354 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1308/2636] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:26.556195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1329/2637] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:26 2022] PUT /identity/v3/projects/d8a7e094ef9e45ddaf4c3a592699b94e/users/3bcad4e827164cf3a12d3dd6859eb853/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:26.568602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eed358-f26a-469e-a733-a7e04af75008 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.569045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eed358-f26a-469e-a733-a7e04af75008 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.569370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eed358-f26a-469e-a733-a7e04af75008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.632672 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b7eed358-f26a-469e-a733-a7e04af75008 None None] MFA Rules not processed for user `3bcad4e827164cf3a12d3dd6859eb853`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:26.635741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b7eed358-f26a-469e-a733-a7e04af75008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:26.736596 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.737136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.737747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.743940 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1309/2638] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:26.746361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eed358-f26a-469e-a733-a7e04af75008 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.780831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:26.783588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:26.843020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eed358-f26a-469e-a733-a7e04af75008 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:26.849284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.850308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.850807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.851301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:26.851976 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:26.853972 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:26.858361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1330/2639] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:25:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:26.870202 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:26.877408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.879283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:26.979086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903d611-af41-40ff-b56b-b7d20f499a12 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:26.990520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1310/2640] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:26 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:26.992226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:26.998014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:26.998661 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:26.998940 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:26.999212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:27.006185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:27.032598 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:27.034257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:27.043558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1331/2641] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:25:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 09:25:27.080646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1d6c8-f4f3-4ec8-a34d-5a119b5c3453 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:27.085537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:27.086192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:27.086478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:27.086753 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:27.087427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:27.100902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:27.223711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1311/2642] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:26 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:27.227853 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:27.239288 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531fc7-b119-4c6b-b342-92bbd94b07a1 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:27.244925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:27.245539 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:27.246293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:27.246718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:27.248325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:27.250025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:27.261919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1332/2643] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:27.266233 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:27.276696 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8ae0a-5858-4f00-8968-b3360eb31ec9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:27.281304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264162e-dd52-4332-a77a-a603c45bad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:27.282400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264162e-dd52-4332-a77a-a603c45bad46 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:27.282575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264162e-dd52-4332-a77a-a603c45bad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:27.282715 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264162e-dd52-4332-a77a-a603c45bad46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:27.283376 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264162e-dd52-4332-a77a-a603c45bad46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:27.284954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264162e-dd52-4332-a77a-a603c45bad46 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:27.294767 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1312/2644] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:27.299491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:27.306303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:27.314755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db2e9-cd02-44c2-8c09-9a12a3c05393 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:27.319815 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:27.320511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:27.320795 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:27.321076 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] PATH_INFO: `/v3/projects/93dbcabf9aec409ba7ac570ce3677cf6/users/a7b94e5749b140aea2a57910dae16e15/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:27.380829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dbcabf9aec409ba7ac570ce3677cf6, user_id=a7b94e5749b140aea2a57910dae16e15, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:27.389934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:27.575089 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1333/2645] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:27 2022] PUT /identity/v3/projects/93dbcabf9aec409ba7ac570ce3677cf6/users/a7b94e5749b140aea2a57910dae16e15/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:27.591737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8303-cf34-45a0-9750-1fd8de16661d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:27.593875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8303-cf34-45a0-9750-1fd8de16661d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:27.593875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8303-cf34-45a0-9750-1fd8de16661d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:27.626068 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-b33b8303-cf34-45a0-9750-1fd8de16661d None None] MFA Rules not processed for user `a7b94e5749b140aea2a57910dae16e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:27.629922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b33b8303-cf34-45a0-9750-1fd8de16661d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:27.701013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1313/2646] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:27.706149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:27.783905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae064-a07a-48af-aaed-783bf89444d9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:27.788605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:27.789936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:27.790225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:27.790576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:27.791214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:27.793145 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:28.133844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1334/2647] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:27 2022] POST /identity/v3/projects => generated 387 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:28.137941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b8303-cf34-45a0-9750-1fd8de16661d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:28.148927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b8303-cf34-45a0-9750-1fd8de16661d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:28.205622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:28.206267 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:28.206548 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:28.206826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:28.207516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:28.209413 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:28.309237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:28.352980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1314/2648] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:28 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:28.355112 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:28.368028 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c41372-208c-47c1-8b72-d10506871cb3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:28.372302 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:28.374737 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:28.375909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:28.375909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:28.376206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:28.378285 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:28.378935 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:28.395678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1335/2649] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:28.396389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:28.408645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531fdda-0990-49f9-9c64-79cdcf48b333 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:28.419836 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:28.420588 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:28.420941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:28.421325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] PATH_INFO: `/v3/projects/4e10e5dfcc3b48758fca22c1f5c4a51c/users/cb85b4090aee4ac78e039aab5e8907f8/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:28.475341 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e10e5dfcc3b48758fca22c1f5c4a51c, user_id=cb85b4090aee4ac78e039aab5e8907f8, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:28.482135 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:28.534220 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:28.563574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1315/2650] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:28 2022] PUT /identity/v3/projects/4e10e5dfcc3b48758fca22c1f5c4a51c/users/cb85b4090aee4ac78e039aab5e8907f8/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:28.566556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:28.581524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786dc5b-3473-4b75-be09-ca2b0fdee3bc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:28.600646 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:28.683304 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e12039-fd50-4ec4-baf8-b35234416802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:28.683941 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12039-fd50-4ec4-baf8-b35234416802 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:28.684214 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12039-fd50-4ec4-baf8-b35234416802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:28.684494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12039-fd50-4ec4-baf8-b35234416802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:28.685590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e12039-fd50-4ec4-baf8-b35234416802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:28.687014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e12039-fd50-4ec4-baf8-b35234416802 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:28.704456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1336/2651] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:28.705164 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:28.717364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083db7-42dd-440f-a59d-d941ec5af3bb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:28.723806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:28.724754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:28.725288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:28.725572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] PATH_INFO: `/v3/projects/4e10e5dfcc3b48758fca22c1f5c4a51c/users/cb85b4090aee4ac78e039aab5e8907f8/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:28.727650 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e10e5dfcc3b48758fca22c1f5c4a51c, user_id=cb85b4090aee4ac78e039aab5e8907f8, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:28.730586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:28.755918 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676bf4-6855-4963-87c6-0cceb1ed7cfa None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:28.756262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676bf4-6855-4963-87c6-0cceb1ed7cfa None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:28.756551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39676bf4-6855-4963-87c6-0cceb1ed7cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:28.759451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1316/2652] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:28 2022] PUT /identity/v3/projects/4e10e5dfcc3b48758fca22c1f5c4a51c/users/cb85b4090aee4ac78e039aab5e8907f8/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:28.817229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-39676bf4-6855-4963-87c6-0cceb1ed7cfa None None] MFA Rules not processed for user `cb85b4090aee4ac78e039aab5e8907f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:28.817229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-39676bf4-6855-4963-87c6-0cceb1ed7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:28.834315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:28.961346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:28.963282 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1337/2653] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:29.333635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:29.400595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f234-6328-42cc-a968-67e7fa2f4e0c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:29.404374 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:29.405217 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:29.405578 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:29.405949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:29.418712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:29.420185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:29.431400 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1317/2654] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:29.519977 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadd1c2-4dfe-4088-a53c-dfad1a2d5df6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:29.520479 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadd1c2-4dfe-4088-a53c-dfad1a2d5df6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:29.520713 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadd1c2-4dfe-4088-a53c-dfad1a2d5df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:29.542567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:29.561905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1aadd1c2-4dfe-4088-a53c-dfad1a2d5df6 None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:29.566694 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1aadd1c2-4dfe-4088-a53c-dfad1a2d5df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:29.653654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1338/2655] 10.222.0.71 () {58 vars in 967 bytes} [Tue Aug 2 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:29.664206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:29.755023 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b292bd-1420-43c3-88ee-08af9ce8ea84 service cinder] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:29.766871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:29.767529 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:29.769826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:29.770129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:29.783694 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:29.787963 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:29.792811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:29.807010 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1318/2656] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:25:30.052163 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:30.103883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:30.747706 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a544a5f-6051-4cb7-a876-c21690b87ed3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:30.748364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a544a5f-6051-4cb7-a876-c21690b87ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:30.748364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a544a5f-6051-4cb7-a876-c21690b87ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:30.771550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7a544a5f-6051-4cb7-a876-c21690b87ed3 None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:30.772792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7a544a5f-6051-4cb7-a876-c21690b87ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:30.780931 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1339/2657] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:25:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:30.800467 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:30.811847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c35d6-1f60-45f4-8559-9e297e124285 service swift] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:30.820142 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a909d-d843-4c79-bd49-f863a23cc32d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:30.820855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a909d-d843-4c79-bd49-f863a23cc32d service swift] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:30.821213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a909d-d843-4c79-bd49-f863a23cc32d service swift] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:30.821562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a909d-d843-4c79-bd49-f863a23cc32d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:30.834204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a909d-d843-4c79-bd49-f863a23cc32d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:30.837651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a909d-d843-4c79-bd49-f863a23cc32d service swift] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:30.846978 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1319/2658] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:25:30.886454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:31.227488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:31.247373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a544a5f-6051-4cb7-a876-c21690b87ed3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:31.259365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a544a5f-6051-4cb7-a876-c21690b87ed3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:31.263430 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:31.288291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:31.288291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:31.288291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:31.320621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:31.322113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:31.331575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1340/2659] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:31.783739 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:32.217900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:32.970857 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:33.005708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4a124-198e-46dc-8bb0-9c8e6c862a2e None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:33.006026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4a124-198e-46dc-8bb0-9c8e6c862a2e None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:33.006308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4a124-198e-46dc-8bb0-9c8e6c862a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:33.027387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f9c4a124-198e-46dc-8bb0-9c8e6c862a2e None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:33.028622 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f9c4a124-198e-46dc-8bb0-9c8e6c862a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:33.038122 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1320/2660] 10.222.0.71 () {58 vars in 967 bytes} [Tue Aug 2 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:33.051337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:33.063905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e933a-ff2b-4ca7-916f-533266990c42 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:33.068819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac01a-d885-49f5-9e0d-67cdec56d8b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:33.069494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac01a-d885-49f5-9e0d-67cdec56d8b0 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:33.069801 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac01a-d885-49f5-9e0d-67cdec56d8b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:33.070085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac01a-d885-49f5-9e0d-67cdec56d8b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:33.078220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ac01a-d885-49f5-9e0d-67cdec56d8b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:33.080649 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ac01a-d885-49f5-9e0d-67cdec56d8b0 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:33.089178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1341/2661] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:25:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:25:33.143684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18006f2-0ba9-4288-9a18-b4a1cf4576f8 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:33.143975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18006f2-0ba9-4288-9a18-b4a1cf4576f8 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:33.144282 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18006f2-0ba9-4288-9a18-b4a1cf4576f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:33.163252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e18006f2-0ba9-4288-9a18-b4a1cf4576f8 None None] MFA Rules not processed for user `db7e0e771edc4659b9f5d3d88aa65a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:33.164459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e18006f2-0ba9-4288-9a18-b4a1cf4576f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:33.225304 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1321/2662] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:33.662161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:33.810493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4c924-ce11-4046-8c2c-2e8debd312fc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:33.810493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4c924-ce11-4046-8c2c-2e8debd312fc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:33.810493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4c924-ce11-4046-8c2c-2e8debd312fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-90d4c924-ce11-4046-8c2c-2e8debd312fc None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:25:33.817035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:25:33.817983 dv-cinder-803823-15-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Aug 02 09:25:33.818954 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1342/2663] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:25:33 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:25:34.049474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:34.050325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:34.050608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:34.072392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] MFA Rules not processed for user `15a779d5df5c4df3bac4ef4fa47c5948`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:34.073619 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:34.081824 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1322/2664] 10.222.0.71 () {58 vars in 967 bytes} [Tue Aug 2 09:25:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:34.095791 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4c924-ce11-4046-8c2c-2e8debd312fc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:34.115176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4c924-ce11-4046-8c2c-2e8debd312fc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:34.121852 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e862f85-3a0e-40cf-b81a-15d6799c3b89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72bd8d0e197643a58f5becd38d1ab474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:34.127718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e862f85-3a0e-40cf-b81a-15d6799c3b89 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:34.127718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e862f85-3a0e-40cf-b81a-15d6799c3b89 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:34.127718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e862f85-3a0e-40cf-b81a-15d6799c3b89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:34.137821 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e862f85-3a0e-40cf-b81a-15d6799c3b89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:34.139526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e862f85-3a0e-40cf-b81a-15d6799c3b89 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:34.149770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1343/2665] 10.222.0.71 () {60 vars in 1384 bytes} [Tue Aug 2 09:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:25:35.051853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:35.733755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:36.512131 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:36.513684 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:36.604143 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1343877-9fd8-498f-a676-c63962ac0638 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:36.610082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:36.610703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:36.610980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:36.611262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] PATH_INFO: `/v3/users/8cdc64ddec6241d39d677affcf7ee517` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:36.612491 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdc64ddec6241d39d677affcf7ee517)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:36.614623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:36.675722 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:36.796888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdc64ddec6241d39d677affcf7ee517'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:36.798309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdc64ddec6241d39d677affcf7ee517'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:36.812427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdc64ddec6241d39d677affcf7ee517'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:36.886768 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:36.887184 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdc64ddec6241d39d677affcf7ee517'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:36.888247 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdc64ddec6241d39d677affcf7ee517'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:36.918595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1323/2666] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:36 2022] DELETE /identity/v3/users/8cdc64ddec6241d39d677affcf7ee517 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:36.923456 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:36.924550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:36.925287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:36.954880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:36.956698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.039014 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1344/2667] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:37.049498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:37.051031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.091678 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:37.093190 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.149033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d00164-0e03-420a-a35f-8ad98cbaceab admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:37.156254 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:37.158337 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:37.158850 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:37.159584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:37.167418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0390f-0f11-4637-b1fe-67de45f40d6d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:37.171329 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204c07f-8d12-4930-b3cf-5f4897f41435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:37.172032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c07f-8d12-4930-b3cf-5f4897f41435 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:37.173631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c07f-8d12-4930-b3cf-5f4897f41435 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:37.174134 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c07f-8d12-4930-b3cf-5f4897f41435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:37.175902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:37.176422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a204c07f-8d12-4930-b3cf-5f4897f41435 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.178003 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:37.193309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1324/2668] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:37.194478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:37.195958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.209977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb30b-54e3-4ef3-9b30-e5266189d1fc service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:37.215481 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:37.216137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:37.216427 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:37.216710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] PATH_INFO: `/v3/users/4e75e7023b9a4e7083d31f9593910ff0` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:37.218057 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e75e7023b9a4e7083d31f9593910ff0)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:37.220112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:37.267628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204c07f-8d12-4930-b3cf-5f4897f41435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:37.270404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204c07f-8d12-4930-b3cf-5f4897f41435 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:37.286460 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1345/2669] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:37.593338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e75e7023b9a4e7083d31f9593910ff0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:37.594876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e75e7023b9a4e7083d31f9593910ff0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:37.633710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e75e7023b9a4e7083d31f9593910ff0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:37.725264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e75e7023b9a4e7083d31f9593910ff0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:37.726235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e75e7023b9a4e7083d31f9593910ff0'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:37.753889 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1325/2670] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:37 2022] DELETE /identity/v3/users/4e75e7023b9a4e7083d31f9593910ff0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:37.754980 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:37.755303 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:37.755605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:37.765781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:37.779505 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:37.782003 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.782777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.894551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55dac-d3af-4e8f-a013-860b178e8d99 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:37.896326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1346/2671] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:37.903045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:37.904226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:37.904710 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:37.905178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] PATH_INFO: `/v3/projects/88edc131af1c4433a6089e2e5117cec8` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:37.906858 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88edc131af1c4433a6089e2e5117cec8)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:37.909557 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:37.912437 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:37.918869 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:37.979331 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5444c-e76a-4483-8dc1-2e3173b589ec None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:37.983845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758620d4-2e9c-4c0d-8100-5bcbde73e91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:37.986407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758620d4-2e9c-4c0d-8100-5bcbde73e91d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:37.986407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758620d4-2e9c-4c0d-8100-5bcbde73e91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:37.986407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758620d4-2e9c-4c0d-8100-5bcbde73e91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:37.998428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758620d4-2e9c-4c0d-8100-5bcbde73e91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:38.000415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758620d4-2e9c-4c0d-8100-5bcbde73e91d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:38.010790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1347/2672] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:25:38.026897 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88edc131af1c4433a6089e2e5117cec8', 'request_id': 'req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.034468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88edc131af1c4433a6089e2e5117cec8', 'request_id': 'req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.043513 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88edc131af1c4433a6089e2e5117cec8', 'request_id': 'req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.064959 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:38.162791 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] The token cache is being invalidate because project 88edc131af1c4433a6089e2e5117cec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:38.163096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.164496 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.166949 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1326/2673] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:37 2022] DELETE /identity/v3/projects/88edc131af1c4433a6089e2e5117cec8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:38.171625 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360893-acaa-43f4-a491-07f5f070199d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.176277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360893-acaa-43f4-a491-07f5f070199d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.179489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360893-acaa-43f4-a491-07f5f070199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.228690 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b0360893-acaa-43f4-a491-07f5f070199d None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:38.231137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b0360893-acaa-43f4-a491-07f5f070199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:38.328535 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:38.330102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:38.360576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1348/2674] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:38.369589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cf28-babc-432d-8d98-da6130cca48b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.370006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cf28-babc-432d-8d98-da6130cca48b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.370404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cf28-babc-432d-8d98-da6130cca48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.412635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bd47cf28-babc-432d-8d98-da6130cca48b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:38.414251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bd47cf28-babc-432d-8d98-da6130cca48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:38.424719 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1349/2675] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:38.429900 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cf28-babc-432d-8d98-da6130cca48b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:38.440967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cf28-babc-432d-8d98-da6130cca48b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:38.453283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:38.456344 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.456964 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.459238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.460154 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:38.461043 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:38.462412 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:38.475790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1350/2676] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:38.480035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:38.486420 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e85b9-7397-45ce-b666-5fcb5dc6a899 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:38.490934 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc324f-6e85-4187-a9c3-a06613191b7f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:38.491545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:38.492192 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.492478 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.492758 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] PATH_INFO: `/v3/projects/7af59bbdbea64841861072ca371647c1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.494358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af59bbdbea64841861072ca371647c1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:38.497058 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:38.501985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:38.502616 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.504203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.504203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.504203 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:38.505744 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:38.628921 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1351/2677] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:38 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:38.633121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:38.658294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af59bbdbea64841861072ca371647c1', 'request_id': 'req-a8463830-8d8b-48a8-ac15-47b681bc3192'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.689505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af59bbdbea64841861072ca371647c1', 'request_id': 'req-a8463830-8d8b-48a8-ac15-47b681bc3192'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.697582 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af59bbdbea64841861072ca371647c1', 'request_id': 'req-a8463830-8d8b-48a8-ac15-47b681bc3192'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.718113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ca343-8fb7-46fe-902e-d47efb028de1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:38.766738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] The token cache is being invalidate because project 7af59bbdbea64841861072ca371647c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:38.767036 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.769053 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-a8463830-8d8b-48a8-ac15-47b681bc3192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:38.789159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1327/2678] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:38 2022] DELETE /identity/v3/projects/7af59bbdbea64841861072ca371647c1 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:38.794416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f13a-b44b-4bdb-9f5c-5ea036a91f54 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.794891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f13a-b44b-4bdb-9f5c-5ea036a91f54 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.795361 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f13a-b44b-4bdb-9f5c-5ea036a91f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.799834 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:38.800484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.800771 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.801052 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.801754 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:38.803785 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:38.867966 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-27b3f13a-b44b-4bdb-9f5c-5ea036a91f54 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:38.875848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-27b3f13a-b44b-4bdb-9f5c-5ea036a91f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:38.890291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1328/2679] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:38.905765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87ec7-5033-4fc8-99e9-c201f08f8b55 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.905765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87ec7-5033-4fc8-99e9-c201f08f8b55 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.905765 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87ec7-5033-4fc8-99e9-c201f08f8b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.917454 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:38.917962 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1352/2680] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:38 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:38.922930 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:38.926576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:38.937474 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-2cf87ec7-5033-4fc8-99e9-c201f08f8b55 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:38.939362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2cf87ec7-5033-4fc8-99e9-c201f08f8b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:38.940054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73547d-3fa8-4051-8b02-96b12f8e22ad admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:38.948916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:38.949638 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:38.949938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:38.950240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:38.950988 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:38.952909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:38.954778 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1329/2681] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:38.969782 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87ec7-5033-4fc8-99e9-c201f08f8b55 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:38.986010 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1353/2682] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:38.992039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87ec7-5033-4fc8-99e9-c201f08f8b55 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:38.996446 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.005134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.005134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.005134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.005134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.005450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:39.005450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.005594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.027663 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4a77-8671-490a-a25f-9652a80ae90a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.033075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.033708 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.034102 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.034447 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.035167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.037121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.043213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1330/2683] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:39.047861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.051850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1354/2684] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:39.058473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.073097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a50a84-cab0-4823-9f6d-ea6cae1c1872 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.076829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c535-8f7b-4a77-a661-0d76bae16b9c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.082288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b4194-35a1-4139-bc39-02c7860edb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.083745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b4194-35a1-4139-bc39-02c7860edb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.084365 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b4194-35a1-4139-bc39-02c7860edb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.084929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b4194-35a1-4139-bc39-02c7860edb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.085161 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.086042 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.086486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.086927 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b4194-35a1-4139-bc39-02c7860edb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.087279 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] PATH_INFO: `/v3/projects/895eb9bf60c441b3b8605a043c28af32/users/4eaa94d64ee344fd8af8c925932ad504/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.089601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b4194-35a1-4139-bc39-02c7860edb94 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.108287 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895eb9bf60c441b3b8605a043c28af32, user_id=4eaa94d64ee344fd8af8c925932ad504, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.111793 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.232351 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1355/2685] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:39 2022] PUT /identity/v3/projects/895eb9bf60c441b3b8605a043c28af32/users/4eaa94d64ee344fd8af8c925932ad504/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:39.239444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1331/2686] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:39 2022] POST /identity/v3/projects => generated 397 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:39.243225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.247309 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbde2a-fb6b-47ec-a2ef-8e1942b51c3c None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.247823 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbde2a-fb6b-47ec-a2ef-8e1942b51c3c None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.248531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbde2a-fb6b-47ec-a2ef-8e1942b51c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.298609 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-e2cbde2a-fb6b-47ec-a2ef-8e1942b51c3c None None] MFA Rules not processed for user `4eaa94d64ee344fd8af8c925932ad504`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:39.299877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-e2cbde2a-fb6b-47ec-a2ef-8e1942b51c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:39.370029 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:39.378667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1775e8e-e638-4e6a-97aa-b177b72c6186 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.460932 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1332/2687] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:39.465605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbde2a-fb6b-47ec-a2ef-8e1942b51c3c None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.519104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.519843 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.520246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.520845 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.521365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.523905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.592159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbde2a-fb6b-47ec-a2ef-8e1942b51c3c None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.605606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.606259 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.606701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.606979 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.607902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.611792 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.650880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1356/2688] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:39 2022] POST /identity/v3/users => generated 299 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:39.656041 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.667629 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff7851-0327-4053-a539-586824c27f73 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.673365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.674399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.674682 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.674982 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.675653 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.677894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.687871 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1357/2689] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:39.691779 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.702176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b39a-721a-49f4-8eea-8b8ef1870048 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.706831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.707434 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.707718 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.711438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.711438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.711438 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.722140 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1358/2690] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:25:39.726088 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.737945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197428e-c64c-4fa5-9eaa-80e2e17e3030 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.744051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1b5f-f684-4f41-ad82-fc3ddbd05ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.744993 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1b5f-f684-4f41-ad82-fc3ddbd05ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.745277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1b5f-f684-4f41-ad82-fc3ddbd05ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.752525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1333/2691] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:39 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:39.753075 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1b5f-f684-4f41-ad82-fc3ddbd05ed6 admin admin] PATH_INFO: `/v3/projects/dd3a4064e64e4a959f6940f9383cd7d6/users/c9f07a5cdf4c4feabc58634bcfdc81c4/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.753179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.762937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1b5f-f684-4f41-ad82-fc3ddbd05ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3a4064e64e4a959f6940f9383cd7d6, user_id=c9f07a5cdf4c4feabc58634bcfdc81c4, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.765792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1b5f-f684-4f41-ad82-fc3ddbd05ed6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.817085 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b0b62-16ba-43f4-a7a0-f4329255fbcb admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:39.821890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:39.822515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.822800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.823076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.823794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:39.833992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:39.881769 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1359/2692] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:39 2022] PUT /identity/v3/projects/dd3a4064e64e4a959f6940f9383cd7d6/users/c9f07a5cdf4c4feabc58634bcfdc81c4/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:39.959504 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd427-2e58-4f93-abf3-3f8b89de8d74 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:39.960715 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd427-2e58-4f93-abf3-3f8b89de8d74 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:39.967656 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cd427-2e58-4f93-abf3-3f8b89de8d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:39.967941 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1334/2693] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:39 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:39.971487 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:39.995156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589cff-ce47-4b9b-aa0c-728272889377 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.006546 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fc3cd427-2e58-4f93-abf3-3f8b89de8d74 None None] MFA Rules not processed for user `c9f07a5cdf4c4feabc58634bcfdc81c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:40.008493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fc3cd427-2e58-4f93-abf3-3f8b89de8d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:40.112557 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1360/2694] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:40.129667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.131777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.131777 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.148049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.148049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:40.148049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:40.148049 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1335/2695] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:40.151700 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cd427-2e58-4f93-abf3-3f8b89de8d74 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:40.163217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cd427-2e58-4f93-abf3-3f8b89de8d74 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.167831 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.168458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.168728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.169009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.169711 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:40.171355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:40.181623 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1361/2696] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:40.185821 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:40.197647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245cd12-3d40-402b-9050-c9e4fc557868 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.208092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182845d-311d-481a-ad2c-ea957215aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.208981 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182845d-311d-481a-ad2c-ea957215aa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.209270 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182845d-311d-481a-ad2c-ea957215aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.209550 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182845d-311d-481a-ad2c-ea957215aa30 admin admin] PATH_INFO: `/v3/projects/b25140da99db4d4e9a4ca490c88a6ca5/users/70ebc41f88a64a1c90b9351cff11cb4f/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.209814 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:40.212337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:40.232891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182845d-311d-481a-ad2c-ea957215aa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25140da99db4d4e9a4ca490c88a6ca5, user_id=70ebc41f88a64a1c90b9351cff11cb4f, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:40.237585 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182845d-311d-481a-ad2c-ea957215aa30 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:40.281293 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105971-0597-480b-b7f7-92b54edb70d8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.285612 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.286276 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.286568 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.286835 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.295375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:40.296828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:40.315138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1336/2697] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:40 2022] PUT /identity/v3/projects/b25140da99db4d4e9a4ca490c88a6ca5/users/70ebc41f88a64a1c90b9351cff11cb4f/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:40.317040 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1362/2698] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:40.324980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11007831-4254-42e2-876f-ee87af6a38e1 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.325275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11007831-4254-42e2-876f-ee87af6a38e1 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.328330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11007831-4254-42e2-876f-ee87af6a38e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.365076 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-11007831-4254-42e2-876f-ee87af6a38e1 None None] MFA Rules not processed for user `70ebc41f88a64a1c90b9351cff11cb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:40.366347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-11007831-4254-42e2-876f-ee87af6a38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:40.463229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1337/2699] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:40.468589 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:40.481937 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73b83-5869-432c-953e-eea47801e3a3 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.561485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.561485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.561485 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.561818 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.563333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:40.566301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:40.601632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:40.663971 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1363/2700] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:40 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:40.664934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11007831-4254-42e2-876f-ee87af6a38e1 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:40.683946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11007831-4254-42e2-876f-ee87af6a38e1 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.768352 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.769132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.769569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.769894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.770647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:40.775146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:40.892386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1338/2701] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:40 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:40.894018 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:40.911691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05461-c33d-46e3-9c50-63c020d6de9b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.916729 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.917457 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.917841 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.918187 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:40.919127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:40.920895 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:40.937481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1364/2702] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:25:40.943958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:40.960319 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ba2f8-045d-4b32-adfe-e0f477bb3547 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:40.975134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:40.975991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:40.976787 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:40.977126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] PATH_INFO: `/v3/projects/989e030238be4d4a91fe742158d33d6c/users/bdc8028c38f1499d9cf4554be8ffa276/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:41.007330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989e030238be4d4a91fe742158d33d6c, user_id=bdc8028c38f1499d9cf4554be8ffa276, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:41.011774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:41.116888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1339/2703] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:40 2022] PUT /identity/v3/projects/989e030238be4d4a91fe742158d33d6c/users/bdc8028c38f1499d9cf4554be8ffa276/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:41.120928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:41.132854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e05cf-71f7-491e-9f31-2fc02d5bef9a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:41.197590 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba302-6d03-4637-8a04-bf331293b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:41.198507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba302-6d03-4637-8a04-bf331293b0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:41.199073 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba302-6d03-4637-8a04-bf331293b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:41.199188 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba302-6d03-4637-8a04-bf331293b0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:41.199894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba302-6d03-4637-8a04-bf331293b0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:41.207755 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba302-6d03-4637-8a04-bf331293b0fe admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:41.212280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1365/2704] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:41.216646 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:41.228081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808d08-80df-4ba7-936a-dfb884807d33 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:41.232853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:41.233517 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:41.233827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:41.234132 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] PATH_INFO: `/v3/projects/989e030238be4d4a91fe742158d33d6c/users/bdc8028c38f1499d9cf4554be8ffa276/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:41.237640 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989e030238be4d4a91fe742158d33d6c, user_id=bdc8028c38f1499d9cf4554be8ffa276, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:41.242152 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:41.251933 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1340/2705] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:41 2022] PUT /identity/v3/projects/989e030238be4d4a91fe742158d33d6c/users/bdc8028c38f1499d9cf4554be8ffa276/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:41.262488 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:41.262777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:41.263054 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:41.302804 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] MFA Rules not processed for user `bdc8028c38f1499d9cf4554be8ffa276`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:41.304263 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:41.392125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1366/2706] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:41.683577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:41.747794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011244b9-04b7-49ef-b2b9-60f3a7aa65a4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:41.751707 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56699b4-b84d-42b1-bbee-837617908215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:41.752335 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56699b4-b84d-42b1-bbee-837617908215 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:41.753024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56699b4-b84d-42b1-bbee-837617908215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:41.753024 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56699b4-b84d-42b1-bbee-837617908215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:41.827986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:41.841538 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56699b4-b84d-42b1-bbee-837617908215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:41.843429 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56699b4-b84d-42b1-bbee-837617908215 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:41.856469 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1341/2707] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:41.967021 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:43.202676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:43.205149 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:43.280340 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:43.336436 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9fd5-0a56-45fb-b871-070a464355c5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:43.344904 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:43.345898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:43.346339 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:43.346772 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] PATH_INFO: `/v3/users/3bcad4e827164cf3a12d3dd6859eb853` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:43.348650 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bcad4e827164cf3a12d3dd6859eb853)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:43.350839 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:43.657452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:43.660783 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bcad4e827164cf3a12d3dd6859eb853'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:43.661513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bcad4e827164cf3a12d3dd6859eb853'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:43.674938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bcad4e827164cf3a12d3dd6859eb853'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:43.681898 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bcad4e827164cf3a12d3dd6859eb853'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:43.784211 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bcad4e827164cf3a12d3dd6859eb853'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:43.791536 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1367/2708] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:43 2022] DELETE /identity/v3/users/3bcad4e827164cf3a12d3dd6859eb853 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:43.795974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:43.796358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:43.796649 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:43.817604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:43.818863 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:43.882129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1342/2709] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:43.892759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:43.894295 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:43.933693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:43.935156 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:43.947815 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24746d28-b4c0-4385-9146-e1d10d119512 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:43.954420 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:43.955324 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:43.955779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:43.956206 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] PATH_INFO: `/v3/users/db7e0e771edc4659b9f5d3d88aa65a2d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:43.957996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7e0e771edc4659b9f5d3d88aa65a2d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:43.960380 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:43.967621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38def-ae51-49a2-8d49-8dea9c992783 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:43.972685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:43.973463 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:43.973848 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:43.975484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:43.990939 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:43.992876 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:44.005676 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1368/2710] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:44.175475 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7e0e771edc4659b9f5d3d88aa65a2d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.176334 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7e0e771edc4659b9f5d3d88aa65a2d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.189048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7e0e771edc4659b9f5d3d88aa65a2d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.251396 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:44.260054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7e0e771edc4659b9f5d3d88aa65a2d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.260054 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7e0e771edc4659b9f5d3d88aa65a2d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.261051 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:44.268458 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1343/2711] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:43 2022] DELETE /identity/v3/users/db7e0e771edc4659b9f5d3d88aa65a2d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:44.326357 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc0533-796e-4ab0-9df8-b8f49bb5d1b0 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:44.395085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:44.395770 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:44.396121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:44.397242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:44.400506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:44.470806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:44.472258 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:44.481465 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1369/2712] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:25:44.498886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:44.500013 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:44.551372 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:44.553086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:44.604251 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533e8f7-e0cc-4ae0-aa83-91283dd72ce3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:44.614926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:44.614926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:44.614926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:44.614926 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] PATH_INFO: `/v3/projects/d8a7e094ef9e45ddaf4c3a592699b94e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:44.618580 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a7e094ef9e45ddaf4c3a592699b94e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:44.618580 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:44.660319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acb18d-315a-4231-a582-c9448762d51f service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:44.664208 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:44.672686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:44.672686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:44.672686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:44.672686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] PATH_INFO: `/v3/projects/67f80a433ec94cf1ba78476615bbcd83` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:44.673450 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f80a433ec94cf1ba78476615bbcd83)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:44.673659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:44.744680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a7e094ef9e45ddaf4c3a592699b94e', 'request_id': 'req-db4951b2-2860-46f1-9569-8d109a081b89'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.751675 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a7e094ef9e45ddaf4c3a592699b94e', 'request_id': 'req-db4951b2-2860-46f1-9569-8d109a081b89'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.763923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a7e094ef9e45ddaf4c3a592699b94e', 'request_id': 'req-db4951b2-2860-46f1-9569-8d109a081b89'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.851328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f80a433ec94cf1ba78476615bbcd83', 'request_id': 'req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.878989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f80a433ec94cf1ba78476615bbcd83', 'request_id': 'req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.890508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] The token cache is being invalidate because project d8a7e094ef9e45ddaf4c3a592699b94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:44.891997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.893137 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:44.895881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:44.898471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1344/2713] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:44 2022] DELETE /identity/v3/projects/d8a7e094ef9e45ddaf4c3a592699b94e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:44.900518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:44.904485 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:44.986332 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4951b2-2860-46f1-9569-8d109a081b89 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:44.994320 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f80a433ec94cf1ba78476615bbcd83', 'request_id': 'req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.008216 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] The token cache is being invalidate because project 67f80a433ec94cf1ba78476615bbcd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:45.008699 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.009454 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.011217 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1370/2714] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:44 2022] DELETE /identity/v3/projects/67f80a433ec94cf1ba78476615bbcd83 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:45.012152 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:45.013462 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:45.052868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:45.053581 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:45.054008 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:45.054296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] PATH_INFO: `/v3/users/b4f57f9f99464d40a4641ed01d868d43` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:45.055633 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f57f9f99464d40a4641ed01d868d43)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:45.058713 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:45.089308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ceb0-77b2-413b-b894-8b341fabe2f6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:45.096645 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:45.101361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:45.101361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:45.101361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] PATH_INFO: `/v3/users/a7b94e5749b140aea2a57910dae16e15` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:45.101361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b94e5749b140aea2a57910dae16e15)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:45.101361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:45.208328 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:45.237572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f57f9f99464d40a4641ed01d868d43'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.238307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f57f9f99464d40a4641ed01d868d43'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.250573 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f57f9f99464d40a4641ed01d868d43'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.306608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b94e5749b140aea2a57910dae16e15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.307257 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b94e5749b140aea2a57910dae16e15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.314645 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f57f9f99464d40a4641ed01d868d43'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.315452 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f57f9f99464d40a4641ed01d868d43'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.320890 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b94e5749b140aea2a57910dae16e15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.328058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b94e5749b140aea2a57910dae16e15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.329229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1345/2715] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:44 2022] DELETE /identity/v3/users/b4f57f9f99464d40a4641ed01d868d43 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:45.330061 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:45.331522 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:45.398502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99356-01db-4a85-9e02-a47287790af9 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:45.403520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:45.404162 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:45.404902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:45.404902 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] PATH_INFO: `/v3/users/062ff1f276dd4d84910667b282ff3991` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:45.405996 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062ff1f276dd4d84910667b282ff3991)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:45.408567 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:45.449607 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-108427a9-b1e2-424e-85bb-65f37179e416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b94e5749b140aea2a57910dae16e15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.456765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1371/2716] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:45 2022] DELETE /identity/v3/users/a7b94e5749b140aea2a57910dae16e15 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:45.458036 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:45.458313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:45.458597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:45.481556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:45.482872 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:45.548458 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1372/2717] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:45.558299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:45.560015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:45.620927 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650c12-942f-4886-b299-ab5752318b4b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:45.624800 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:45.625960 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:45.626245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:45.626524 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:45.635432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:45.637164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:45.642917 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062ff1f276dd4d84910667b282ff3991'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.643654 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062ff1f276dd4d84910667b282ff3991'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.647133 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1373/2718] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:25:45.676507 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062ff1f276dd4d84910667b282ff3991'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.760737 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062ff1f276dd4d84910667b282ff3991'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.761480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062ff1f276dd4d84910667b282ff3991'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:45.783153 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1346/2719] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:45 2022] DELETE /identity/v3/users/062ff1f276dd4d84910667b282ff3991 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:46.038697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:46.040403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:46.055511 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd500767-3f2f-4ef5-ba79-17aaaa6b4f96 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:46.128052 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:46.130362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:46.156974 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:46.157654 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:46.157976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:46.158259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] PATH_INFO: `/v3/projects/93dbcabf9aec409ba7ac570ce3677cf6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:46.160012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93dbcabf9aec409ba7ac570ce3677cf6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:46.162039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:46.209294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5ae0-b455-4f4a-831c-88b59de21570 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:46.213734 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:46.214395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:46.214676 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:46.214952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] PATH_INFO: `/v3/projects/f7865cce9ad244728822c1ff3e443f4e` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:46.216099 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7865cce9ad244728822c1ff3e443f4e)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:46.218039 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:46.274375 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93dbcabf9aec409ba7ac570ce3677cf6', 'request_id': 'req-996af1be-edb7-47c1-91a0-42d747bdd98d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.280506 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93dbcabf9aec409ba7ac570ce3677cf6', 'request_id': 'req-996af1be-edb7-47c1-91a0-42d747bdd98d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.370440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7865cce9ad244728822c1ff3e443f4e', 'request_id': 'req-cb679930-87a1-4545-8cd9-a3a37bbb1e83'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.370553 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93dbcabf9aec409ba7ac570ce3677cf6', 'request_id': 'req-996af1be-edb7-47c1-91a0-42d747bdd98d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.372325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7865cce9ad244728822c1ff3e443f4e', 'request_id': 'req-cb679930-87a1-4545-8cd9-a3a37bbb1e83'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.379995 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7865cce9ad244728822c1ff3e443f4e', 'request_id': 'req-cb679930-87a1-4545-8cd9-a3a37bbb1e83'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.382901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] The token cache is being invalidate because project 93dbcabf9aec409ba7ac570ce3677cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:46.383336 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.384271 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.386337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1374/2720] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:46 2022] DELETE /identity/v3/projects/93dbcabf9aec409ba7ac570ce3677cf6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:46.387114 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:46.388501 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:46.466666 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996af1be-edb7-47c1-91a0-42d747bdd98d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:46.474204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] The token cache is being invalidate because project f7865cce9ad244728822c1ff3e443f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:46.474736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.475392 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.477516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1347/2721] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:46 2022] DELETE /identity/v3/projects/f7865cce9ad244728822c1ff3e443f4e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:46.478772 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:46.480685 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:46.493272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:46.546178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:46.547639 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:46.548206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:46.548515 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] PATH_INFO: `/v3/projects/c329349544cb43e4ba5d9a324f59529f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:46.550079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c329349544cb43e4ba5d9a324f59529f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:46.552570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:46.584892 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb679930-87a1-4545-8cd9-a3a37bbb1e83 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:46.603126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:46.603961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:46.604313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:46.604733 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] PATH_INFO: `/v3/users/cb85b4090aee4ac78e039aab5e8907f8` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:46.606272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb85b4090aee4ac78e039aab5e8907f8)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:46.608438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:46.868957 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c329349544cb43e4ba5d9a324f59529f', 'request_id': 'req-59ef665b-0dbb-4cc0-b408-31d1d004b699'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.870963 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb85b4090aee4ac78e039aab5e8907f8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.872828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb85b4090aee4ac78e039aab5e8907f8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.876608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c329349544cb43e4ba5d9a324f59529f', 'request_id': 'req-59ef665b-0dbb-4cc0-b408-31d1d004b699'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.887690 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb85b4090aee4ac78e039aab5e8907f8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.958805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:46.987368 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c329349544cb43e4ba5d9a324f59529f', 'request_id': 'req-59ef665b-0dbb-4cc0-b408-31d1d004b699'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:46.999378 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] The token cache is being invalidate because project c329349544cb43e4ba5d9a324f59529f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:46.999668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.001477 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.003106 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1375/2722] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:46 2022] DELETE /identity/v3/projects/c329349544cb43e4ba5d9a324f59529f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:47.003875 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:47.005210 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:47.068999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb85b4090aee4ac78e039aab5e8907f8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.069742 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb85b4090aee4ac78e039aab5e8907f8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.075451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef665b-0dbb-4cc0-b408-31d1d004b699 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:47.080691 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:47.081509 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:47.081825 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:47.082107 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:47.084452 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:47.091928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1348/2723] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:46 2022] DELETE /identity/v3/users/cb85b4090aee4ac78e039aab5e8907f8 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:47.167292 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:47.168836 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:47.181268 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1376/2724] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:47.505075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:47.506653 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:47.558471 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:47.598506 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2b19-08df-465c-8258-0d123e499880 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:47.603213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:47.603868 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:47.604150 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:47.604514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] PATH_INFO: `/v3/users/c9f07a5cdf4c4feabc58634bcfdc81c4` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:47.605693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f07a5cdf4c4feabc58634bcfdc81c4)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:47.607839 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:47.692243 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:47.694053 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:47.774538 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56309-7ee3-49a4-bd9e-cb137e2c98dd service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:47.779138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:47.779777 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:47.780059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:47.780335 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] PATH_INFO: `/v3/projects/4e10e5dfcc3b48758fca22c1f5c4a51c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:47.781555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e10e5dfcc3b48758fca22c1f5c4a51c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:47.785403 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:47.818235 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f07a5cdf4c4feabc58634bcfdc81c4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.818905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f07a5cdf4c4feabc58634bcfdc81c4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.831486 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f07a5cdf4c4feabc58634bcfdc81c4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.908364 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e10e5dfcc3b48758fca22c1f5c4a51c', 'request_id': 'req-69b0db50-e6ab-4978-b441-74bac4508d53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.913521 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f07a5cdf4c4feabc58634bcfdc81c4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.914049 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e10e5dfcc3b48758fca22c1f5c4a51c', 'request_id': 'req-69b0db50-e6ab-4978-b441-74bac4508d53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.914369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-68ebcae4-04c2-4fdf-98b3-c87b02e82ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f07a5cdf4c4feabc58634bcfdc81c4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:47.927722 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1349/2725] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:47 2022] DELETE /identity/v3/users/c9f07a5cdf4c4feabc58634bcfdc81c4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:47.932204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:47.932518 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:47.932801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:47.951961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:47.953174 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.010408 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:48.014095 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1350/2726] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:48.024785 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.026133 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.038575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e10e5dfcc3b48758fca22c1f5c4a51c', 'request_id': 'req-69b0db50-e6ab-4978-b441-74bac4508d53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.050986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] The token cache is being invalidate because project 4e10e5dfcc3b48758fca22c1f5c4a51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:48.051280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.057122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-69b0db50-e6ab-4978-b441-74bac4508d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.057122 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1377/2727] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:47 2022] DELETE /identity/v3/projects/4e10e5dfcc3b48758fca22c1f5c4a51c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:48.061662 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ebf48-8760-4733-8460-091f4c8a2c25 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.061916 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ebf48-8760-4733-8460-091f4c8a2c25 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.062199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ebf48-8760-4733-8460-091f4c8a2c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.083059 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0a3ebf48-8760-4733-8460-091f4c8a2c25 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:48.084367 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0a3ebf48-8760-4733-8460-091f4c8a2c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.088572 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916b3a3-b641-4270-b8d6-32f8c2578973 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.092394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.092559 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1378/2728] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:48.093009 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.093289 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.093565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.095575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.101355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b213d-f981-417d-ab60-c618a875c067 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.101806 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b213d-f981-417d-ab60-c618a875c067 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.102099 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b213d-f981-417d-ab60-c618a875c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.110260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.112169 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.122576 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-268b213d-f981-417d-ab60-c618a875c067 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:48.122763 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1351/2729] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:25:48.123805 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-268b213d-f981-417d-ab60-c618a875c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.132846 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1379/2730] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:48.137157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.150425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d3a9-5e2c-4f30-8733-d40ac814eeef service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.156291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.157185 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.157473 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.157784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.158484 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:48.158912 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.160970 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.175515 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1352/2731] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:48.179526 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b213d-f981-417d-ab60-c618a875c067 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.189888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b213d-f981-417d-ab60-c618a875c067 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.194726 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.195348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.195630 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.195911 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.196581 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.198542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.298228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1380/2732] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:48 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:48.299462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.309625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dc2ec-58a1-4fa6-a2d2-fd03aec027ce admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.371831 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.372492 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.372779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.373112 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.373774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.376366 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.505918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1353/2733] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:48 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:48.510057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.523039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3d0dd-6713-4e2d-b116-06933e82d9a7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.528806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.529618 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.530422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.530577 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.530774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.531118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.532050 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.534444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.545333 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1381/2734] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:48.549948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.555315 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01cf79-f2e0-4ce2-b1c6-640525a7880d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.561508 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.562386 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.562731 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.563891 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] PATH_INFO: `/v3/projects/dd3a4064e64e4a959f6940f9383cd7d6` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.565418 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3a4064e64e4a959f6940f9383cd7d6)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.567438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.568168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207526-d430-490a-a943-1ffa0f540edb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.572952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.573565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.573901 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.574199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.574199 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.577249 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.592440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1382/2735] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:25:48.597529 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.609009 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45565-e64c-4659-b081-41b3c6d3ea26 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.615266 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f5c01-40f9-46ce-87fc-96d3aa1bf5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.616079 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f5c01-40f9-46ce-87fc-96d3aa1bf5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.616286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f5c01-40f9-46ce-87fc-96d3aa1bf5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.616882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f5c01-40f9-46ce-87fc-96d3aa1bf5ab admin admin] PATH_INFO: `/v3/projects/e62403eadf1b4efaba87f93fc0f4f348/users/a26933914809437187bb4d7a66e72788/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.618948 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:48.639540 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f5c01-40f9-46ce-87fc-96d3aa1bf5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62403eadf1b4efaba87f93fc0f4f348, user_id=a26933914809437187bb4d7a66e72788, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:48.643491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f5c01-40f9-46ce-87fc-96d3aa1bf5ab admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:48.721476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1383/2736] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:48 2022] PUT /identity/v3/projects/e62403eadf1b4efaba87f93fc0f4f348/users/a26933914809437187bb4d7a66e72788/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:48.744221 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3a4064e64e4a959f6940f9383cd7d6', 'request_id': 'req-426ceb41-b9da-4b50-82be-d1c58f505c1f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.753497 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3a4064e64e4a959f6940f9383cd7d6', 'request_id': 'req-426ceb41-b9da-4b50-82be-d1c58f505c1f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.761394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3a4064e64e4a959f6940f9383cd7d6', 'request_id': 'req-426ceb41-b9da-4b50-82be-d1c58f505c1f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.797579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.797891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.798178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:48.826393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] MFA Rules not processed for user `a26933914809437187bb4d7a66e72788`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:48.827453 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.846313 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:48.853219 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] The token cache is being invalidate because project dd3a4064e64e4a959f6940f9383cd7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:48.854900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.854900 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:48.855709 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1354/2737] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:48 2022] DELETE /identity/v3/projects/dd3a4064e64e4a959f6940f9383cd7d6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:48.909348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1384/2738] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:25:48.922294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:48.924459 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:48.991494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ceb41-b9da-4b50-82be-d1c58f505c1f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:48.995275 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27660c6-c9a0-44ce-bea2-d4afe142bf38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:48.996087 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27660c6-c9a0-44ce-bea2-d4afe142bf38 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:48.996356 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27660c6-c9a0-44ce-bea2-d4afe142bf38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:48.996935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27660c6-c9a0-44ce-bea2-d4afe142bf38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:49.007613 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27660c6-c9a0-44ce-bea2-d4afe142bf38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:49.009134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27660c6-c9a0-44ce-bea2-d4afe142bf38 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:49.020611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1355/2739] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:49.040312 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:49.041803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:49.119803 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec091-b142-4a65-b509-d9948d9e6a33 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:49.126100 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:49.126849 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:49.127132 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:49.127449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] PATH_INFO: `/v3/users/a26933914809437187bb4d7a66e72788` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:49.128868 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26933914809437187bb4d7a66e72788)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:49.130995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:49.340893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26933914809437187bb4d7a66e72788'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:49.341484 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26933914809437187bb4d7a66e72788'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:49.354743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26933914809437187bb4d7a66e72788'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:49.361844 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26933914809437187bb4d7a66e72788'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:49.440183 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26933914809437187bb4d7a66e72788'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:49.446681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1385/2740] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:49 2022] DELETE /identity/v3/users/a26933914809437187bb4d7a66e72788 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:49.451457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:49.451781 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:49.452060 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:49.472745 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:49.474019 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:49.533774 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1356/2741] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:49.543348 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:49.544790 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:49.552086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:49.595347 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:49.606696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1e5b0-5af9-4cb7-849d-cc31b0c2ecb6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:49.611038 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c51fd-1cd4-42f1-a123-6bfa5ad4df73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:49.611652 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c51fd-1cd4-42f1-a123-6bfa5ad4df73 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:49.612064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c51fd-1cd4-42f1-a123-6bfa5ad4df73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:49.612374 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c51fd-1cd4-42f1-a123-6bfa5ad4df73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:49.622011 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c51fd-1cd4-42f1-a123-6bfa5ad4df73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:49.623508 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c51fd-1cd4-42f1-a123-6bfa5ad4df73 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:49.634284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1386/2742] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:49.874924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:49.914859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:50.046621 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:50.049980 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:50.063974 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3e44c-294d-4bcc-9f22-6cc53b6d2c92 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:50.070828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:50.071905 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.072534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.072999 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] PATH_INFO: `/v3/projects/e62403eadf1b4efaba87f93fc0f4f348` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.074246 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62403eadf1b4efaba87f93fc0f4f348)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:50.078600 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:50.193113 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62403eadf1b4efaba87f93fc0f4f348', 'request_id': 'req-62331358-a2cc-43d1-9247-373761a280bd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:50.200327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62403eadf1b4efaba87f93fc0f4f348', 'request_id': 'req-62331358-a2cc-43d1-9247-373761a280bd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:50.206547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62403eadf1b4efaba87f93fc0f4f348', 'request_id': 'req-62331358-a2cc-43d1-9247-373761a280bd'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:50.302261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] The token cache is being invalidate because project e62403eadf1b4efaba87f93fc0f4f348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:50.302651 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:50.303195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-62331358-a2cc-43d1-9247-373761a280bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:50.304744 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1357/2743] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:50 2022] DELETE /identity/v3/projects/e62403eadf1b4efaba87f93fc0f4f348 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:50.309565 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce0a4-e538-4052-9e42-12ee6985d306 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.309938 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce0a4-e538-4052-9e42-12ee6985d306 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.310225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce0a4-e538-4052-9e42-12ee6985d306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.330490 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ab2ce0a4-e538-4052-9e42-12ee6985d306 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:50.331688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ab2ce0a4-e538-4052-9e42-12ee6985d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:50.372250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:50.395681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1387/2744] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:50.403479 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c99f1-c4ba-4026-8a40-42cf338a227f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.403764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c99f1-c4ba-4026-8a40-42cf338a227f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.404177 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c99f1-c4ba-4026-8a40-42cf338a227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.427250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-216c99f1-c4ba-4026-8a40-42cf338a227f None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:50.428520 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-216c99f1-c4ba-4026-8a40-42cf338a227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:50.437330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1358/2745] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:50.441698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ce0a4-e538-4052-9e42-12ee6985d306 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:50.451728 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ce0a4-e538-4052-9e42-12ee6985d306 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:50.461468 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:50.462138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.464981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.464981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.464981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:50.464981 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:50.465350 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:50.478926 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1388/2746] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:50.483198 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c99f1-c4ba-4026-8a40-42cf338a227f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:50.486774 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:50.493446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c99f1-c4ba-4026-8a40-42cf338a227f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:50.498627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:50.499253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.499537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.499871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.501351 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:50.503295 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:50.612757 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1359/2747] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:50 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:50.618046 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:50.642675 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee9a11-b69e-4cfb-acf7-2b0c6b1e0dba admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:50.696134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=100 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:50.705225 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:50.705888 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.706174 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.706451 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.707138 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:50.709245 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:50.743802 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:50.811176 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1389/2748] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:50 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:50.812628 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:50.824089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806c44-f633-4b4f-bd6a-547d1fff96a3 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:50.828703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:50.829306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.829594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.829906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.830605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:50.832248 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:50.842500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1360/2749] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:50.847681 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:50.868022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ab9d-aa55-4405-b85d-1fa67701ed70 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:50.873487 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dff0c-5714-4025-9a32-b732b205757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:50.874175 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dff0c-5714-4025-9a32-b732b205757b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.874587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dff0c-5714-4025-9a32-b732b205757b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.875005 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dff0c-5714-4025-9a32-b732b205757b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.876603 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dff0c-5714-4025-9a32-b732b205757b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:50.878382 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dff0c-5714-4025-9a32-b732b205757b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:50.880923 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:50.890570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1390/2750] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:50.895800 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:50.912136 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cfdce-212c-4c1d-b952-a31cca61d8ce admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:50.917096 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:50.918004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:50.918308 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:50.927419 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] PATH_INFO: `/v3/projects/09cb55995b6f496fa3a7f0dda32a9a17/users/f27e2bf4670c4447a26a0c4005790038/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:50.934018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cb55995b6f496fa3a7f0dda32a9a17, user_id=f27e2bf4670c4447a26a0c4005790038, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:50.936783 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:51.028172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1361/2751] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:50 2022] PUT /identity/v3/projects/09cb55995b6f496fa3a7f0dda32a9a17/users/f27e2bf4670c4447a26a0c4005790038/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:51.039012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:51.039298 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:51.039577 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:51.069047 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] MFA Rules not processed for user `f27e2bf4670c4447a26a0c4005790038`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:51.070322 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:51.138522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1391/2752] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:51.149816 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:51.151693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:51.153121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:51.212051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6272d-2335-4ab0-a222-1679cb4c665f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:51.215760 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08ef61-0967-410c-a7d8-fa285ca96993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:51.216377 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08ef61-0967-410c-a7d8-fa285ca96993 service cinder] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:51.216656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08ef61-0967-410c-a7d8-fa285ca96993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:51.216928 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08ef61-0967-410c-a7d8-fa285ca96993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:51.225534 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08ef61-0967-410c-a7d8-fa285ca96993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:51.226997 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08ef61-0967-410c-a7d8-fa285ca96993 service cinder] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:51.237106 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1362/2753] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:51.358637 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:51.440847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:51.766465 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:51.848062 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:52.037178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:52.037178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:52.051348 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed288-c493-41a9-ab91-c20767336b0a None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:52.051679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed288-c493-41a9-ab91-c20767336b0a None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:52.052274 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed288-c493-41a9-ab91-c20767336b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-625ed288-c493-41a9-ab91-c20767336b0a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:25:52.059264 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:25:52.060355 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:25:52.061526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1363/2754] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:25:52 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 02 09:25:52.115086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f7a01-119a-487f-a02f-8ef54ad88446 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:52.120167 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:52.120899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:52.121191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:52.121473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] PATH_INFO: `/v3/users/4eaa94d64ee344fd8af8c925932ad504` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:52.123058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaa94d64ee344fd8af8c925932ad504)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:52.125030 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:52.362061 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaa94d64ee344fd8af8c925932ad504'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:52.362794 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaa94d64ee344fd8af8c925932ad504'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:52.377399 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaa94d64ee344fd8af8c925932ad504'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:52.385004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaa94d64ee344fd8af8c925932ad504'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:52.478314 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaa94d64ee344fd8af8c925932ad504'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:52.485094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1392/2755] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:52 2022] DELETE /identity/v3/users/4eaa94d64ee344fd8af8c925932ad504 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:52.490819 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6290-86dc-4af1-90f4-247461040444 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:52.491568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6290-86dc-4af1-90f4-247461040444 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:52.491568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6290-86dc-4af1-90f4-247461040444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:52.513389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-236e6290-86dc-4af1-90f4-247461040444 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:52.514796 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-236e6290-86dc-4af1-90f4-247461040444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:52.587539 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1364/2756] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:52.597759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:52.599155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:52.659204 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e761f69-f310-4bd0-b654-37b27bc8b5af admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:52.663025 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:52.663648 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:52.664158 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:52.664448 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:52.675185 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:52.676714 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:52.686492 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1393/2757] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:25:52.833129 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:52.892905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:53.127463 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:53.298473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:53.508007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6290-86dc-4af1-90f4-247461040444 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:53.509551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-236e6290-86dc-4af1-90f4-247461040444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:53.524370 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6290-86dc-4af1-90f4-247461040444 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:53.530303 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:53.536301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:53.536301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:53.536301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] PATH_INFO: `/v3/projects/895eb9bf60c441b3b8605a043c28af32` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:53.536301 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895eb9bf60c441b3b8605a043c28af32)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:53.544425 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:53.670504 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:53.679985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895eb9bf60c441b3b8605a043c28af32', 'request_id': 'req-ab1cd845-e270-43f5-99c4-84302193dc67'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:53.689906 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895eb9bf60c441b3b8605a043c28af32', 'request_id': 'req-ab1cd845-e270-43f5-99c4-84302193dc67'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:53.696895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895eb9bf60c441b3b8605a043c28af32', 'request_id': 'req-ab1cd845-e270-43f5-99c4-84302193dc67'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:53.770094 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] The token cache is being invalidate because project 895eb9bf60c441b3b8605a043c28af32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:53.770389 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:53.771033 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:53.772828 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1365/2758] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:53 2022] DELETE /identity/v3/projects/895eb9bf60c441b3b8605a043c28af32 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:53.776762 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:53.788125 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a623a85-b804-482d-9a2b-96c6df1e973a service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:53.850085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:53.850945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:53.851218 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:53.851496 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] PATH_INFO: `/v3/users/70ebc41f88a64a1c90b9351cff11cb4f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:53.852672 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ebc41f88a64a1c90b9351cff11cb4f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:53.854919 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:53.880212 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:54.121242 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ebc41f88a64a1c90b9351cff11cb4f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:54.122294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ebc41f88a64a1c90b9351cff11cb4f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:54.140397 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ebc41f88a64a1c90b9351cff11cb4f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:54.150229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ebc41f88a64a1c90b9351cff11cb4f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:54.240207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ebc41f88a64a1c90b9351cff11cb4f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:54.247246 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1394/2759] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:53 2022] DELETE /identity/v3/users/70ebc41f88a64a1c90b9351cff11cb4f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:54.412310 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:54.555558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:54.678101 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:54.726258 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:54.823441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:54.853369 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:54.856562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:54.886444 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd845-e270-43f5-99c4-84302193dc67 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:54.966569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:54.967330 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:54.967682 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:54.968028 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] PATH_INFO: `/v3/projects/b25140da99db4d4e9a4ca490c88a6ca5` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:54.969480 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25140da99db4d4e9a4ca490c88a6ca5)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:54.971712 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:55.135826 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25140da99db4d4e9a4ca490c88a6ca5', 'request_id': 'req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.148751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25140da99db4d4e9a4ca490c88a6ca5', 'request_id': 'req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.155751 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25140da99db4d4e9a4ca490c88a6ca5', 'request_id': 'req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.272969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] The token cache is being invalidate because project b25140da99db4d4e9a4ca490c88a6ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:55.275881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.275881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.275881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1366/2760] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:54 2022] DELETE /identity/v3/projects/b25140da99db4d4e9a4ca490c88a6ca5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:55.284494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:55.284494 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:55.296928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d48877-182d-4683-aa77-2e8c5af6e7ea admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:55.360945 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:55.362108 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:55.362556 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:55.363006 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] PATH_INFO: `/v3/users/bdc8028c38f1499d9cf4554be8ffa276` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:55.375169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:55.379428 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc8028c38f1499d9cf4554be8ffa276)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:55.381566 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:55.480391 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:55.585924 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc8028c38f1499d9cf4554be8ffa276'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.586586 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc8028c38f1499d9cf4554be8ffa276'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.605480 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc8028c38f1499d9cf4554be8ffa276'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.613415 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc8028c38f1499d9cf4554be8ffa276'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.708765 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b938fe7b-7ab5-4d74-a6b5-64d25b22e37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc8028c38f1499d9cf4554be8ffa276'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:55.715160 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1395/2761] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:25:55 2022] DELETE /identity/v3/users/bdc8028c38f1499d9cf4554be8ffa276 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:55.880786 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:56.233599 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:56.235708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:56.269414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f392-4f2e-42ed-bcc8-b3cc6c6ecf69 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:56.353877 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:56.354584 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:56.354871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:56.355149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] PATH_INFO: `/v3/projects/989e030238be4d4a91fe742158d33d6c` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:56.360764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989e030238be4d4a91fe742158d33d6c)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:56.367146 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:56.472229 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989e030238be4d4a91fe742158d33d6c', 'request_id': 'req-d1f5f428-896f-4880-838b-af3d7d9d7372'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:56.479360 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989e030238be4d4a91fe742158d33d6c', 'request_id': 'req-d1f5f428-896f-4880-838b-af3d7d9d7372'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:56.485657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989e030238be4d4a91fe742158d33d6c', 'request_id': 'req-d1f5f428-896f-4880-838b-af3d7d9d7372'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:56.525031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:56.571516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] The token cache is being invalidate because project 989e030238be4d4a91fe742158d33d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:25:56.571867 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:56.572575 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-d1f5f428-896f-4880-838b-af3d7d9d7372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:25:56.574166 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1367/2762] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:25:56 2022] DELETE /identity/v3/projects/989e030238be4d4a91fe742158d33d6c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:56.580064 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3819ed-9c2c-4754-880a-47308104a5e4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:56.580545 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3819ed-9c2c-4754-880a-47308104a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:56.580899 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3819ed-9c2c-4754-880a-47308104a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:56.601224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fc3819ed-9c2c-4754-880a-47308104a5e4 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:56.602481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fc3819ed-9c2c-4754-880a-47308104a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:56.625440 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:56.670032 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1396/2763] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:56.678677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0734-7563-4e18-a9bb-9da34b25ca97 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:56.678934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0734-7563-4e18-a9bb-9da34b25ca97 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:56.679333 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0734-7563-4e18-a9bb-9da34b25ca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:56.699602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-5aeb0734-7563-4e18-a9bb-9da34b25ca97 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:56.700888 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-5aeb0734-7563-4e18-a9bb-9da34b25ca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:56.710123 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1368/2764] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:56.714180 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3819ed-9c2c-4754-880a-47308104a5e4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:56.724776 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3819ed-9c2c-4754-880a-47308104a5e4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:56.729829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:56.732969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:56.732969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:56.732969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:56.732969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:25:56.732969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:56.733965 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:56.746124 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1397/2765] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:25:56.751149 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0734-7563-4e18-a9bb-9da34b25ca97 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:56.760349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0734-7563-4e18-a9bb-9da34b25ca97 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:56.765261 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:56.766395 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:56.766779 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:56.767050 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:56.767838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:56.769935 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:56.883160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1369/2766] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:56 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:56.888191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:56.900531 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a001-c32b-4ed8-976c-79e36b2c0c96 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:56.975215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:56.975867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:56.976213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:56.976685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:56.977560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:56.979894 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:57.098838 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1398/2767] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:56 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:57.113754 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:57.130545 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9ac5d-642e-4d07-a44d-0eaba029705c admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:57.137697 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:57.138349 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:57.138688 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:57.139476 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:57.140291 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:57.143078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:57.155842 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1370/2768] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:57.158644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:57.160417 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:57.171147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c77de2-4e27-4099-a74c-92588ede3094 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:57.181127 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b64b-4938-47a5-a5b2-01c91b522f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:57.189772 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b64b-4938-47a5-a5b2-01c91b522f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:57.190000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:57.191466 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b64b-4938-47a5-a5b2-01c91b522f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:57.191760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b64b-4938-47a5-a5b2-01c91b522f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:57.192510 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81b64b-4938-47a5-a5b2-01c91b522f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:57.194178 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81b64b-4938-47a5-a5b2-01c91b522f03 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:57.210880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1399/2769] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:57.211945 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:57.223266 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d9f7-4239-45b9-9d7b-64fe2f4aa433 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:57.228878 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:57.232537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:57.232537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:57.232537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] PATH_INFO: `/v3/projects/9c4798fa212e408c8eeaeb0a4317d53f/users/0c5e991ab0b54e5e8b82e2357c91b5d8/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:57.254018 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4798fa212e408c8eeaeb0a4317d53f, user_id=0c5e991ab0b54e5e8b82e2357c91b5d8, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:57.258451 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:57.364115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1371/2770] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:57 2022] PUT /identity/v3/projects/9c4798fa212e408c8eeaeb0a4317d53f/users/0c5e991ab0b54e5e8b82e2357c91b5d8/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:57.437695 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe34a-8d70-48cd-b523-9eb392b8b97d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:57.438220 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe34a-8d70-48cd-b523-9eb392b8b97d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:57.438563 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe34a-8d70-48cd-b523-9eb392b8b97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:57.475743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4cbbe34a-8d70-48cd-b523-9eb392b8b97d None None] MFA Rules not processed for user `0c5e991ab0b54e5e8b82e2357c91b5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:57.477086 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4cbbe34a-8d70-48cd-b523-9eb392b8b97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:57.558345 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1400/2771] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:57.559065 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:57.636502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b9e4c-dbb3-4a24-9c92-11abdd59520f admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:57.643702 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:57.644379 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:57.644991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:57.645526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:57.646422 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:57.647975 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:57.652329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:57.743701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1372/2772] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:57 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:25:57.748104 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbe34a-8d70-48cd-b523-9eb392b8b97d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:57.771347 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbe34a-8d70-48cd-b523-9eb392b8b97d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:57.837697 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:57.838473 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:57.839000 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:57.839171 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:57.839985 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:57.842614 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:57.847544 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:57.973166 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1401/2773] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:57 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:57.974527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:57.986983 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525ec9-142b-4db7-838c-315db2905449 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:57.991648 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:57.992326 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:57.992671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:57.993031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:57.993871 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:57.995470 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:58.007797 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1373/2774] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:58.011909 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:58.022550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ebb82-a36c-4d82-a91b-e77664873cac admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:58.027373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba4152-3fa6-4a96-a008-fcb14b72b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:58.028113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4152-3fa6-4a96-a008-fcb14b72b059 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:58.028277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4152-3fa6-4a96-a008-fcb14b72b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:58.028558 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4152-3fa6-4a96-a008-fcb14b72b059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:58.029259 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba4152-3fa6-4a96-a008-fcb14b72b059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:58.037747 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba4152-3fa6-4a96-a008-fcb14b72b059 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:58.051605 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1402/2775] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:58.057922 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:58.070032 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db7b2-758e-4f1b-87d1-61e914601824 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:58.076598 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:58.090446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:58.090446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:58.090446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:58.090446 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] PATH_INFO: `/v3/projects/b3e180cd15404806be59dd9a1e83ecc4/users/cdb42b7f7e09405da73a0e6e5e7b4d72/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:58.116139 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e180cd15404806be59dd9a1e83ecc4, user_id=cdb42b7f7e09405da73a0e6e5e7b4d72, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:58.118925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:58.201436 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1374/2776] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:58 2022] PUT /identity/v3/projects/b3e180cd15404806be59dd9a1e83ecc4/users/cdb42b7f7e09405da73a0e6e5e7b4d72/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:25:58.212664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df8b49-ea87-4ade-8971-a73862e5fd72 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:58.212952 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df8b49-ea87-4ade-8971-a73862e5fd72 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:58.213366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df8b49-ea87-4ade-8971-a73862e5fd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:58.258007 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-66df8b49-ea87-4ade-8971-a73862e5fd72 None None] MFA Rules not processed for user `cdb42b7f7e09405da73a0e6e5e7b4d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:58.260105 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-66df8b49-ea87-4ade-8971-a73862e5fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:58.362499 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1403/2777] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:58.372501 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:58.417829 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:58.463907 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f516-5189-4599-ade2-9294db16c403 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:58.468659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:58.473284 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:58.474045 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:58.474340 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:58.474756 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:58.475647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:58.477700 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:58.575602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1375/2778] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:25:58 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:58.577325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df8b49-ea87-4ade-8971-a73862e5fd72 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:58.594449 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df8b49-ea87-4ade-8971-a73862e5fd72 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:58.683475 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:58.684121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:58.684404 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:58.686635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:58.686635 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:58.687300 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:58.751631 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1404/2779] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:25:58 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:25:58.757882 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:58.758180 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:58.772250 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758cd4f-d799-4d76-a460-bf02243ae4ad admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:58.777870 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:58.778741 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:58.779394 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:58.783732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:58.783732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:58.783732 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:58.802228 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:58.809920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1376/2780] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:58.814223 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0e465-d2fe-4a09-871e-89a52f36b1bd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:58.818325 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:58.823880 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:58.824571 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:58.824855 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:58.825137 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] PATH_INFO: `/v3/projects/67170a2e034f414288f2f695af3f4009/users/1c156a74b41d45aab86fda3439a69f0f/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:58.845129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=67170a2e034f414288f2f695af3f4009, user_id=1c156a74b41d45aab86fda3439a69f0f, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:58.848264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:58.948419 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1405/2781] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:58 2022] PUT /identity/v3/projects/67170a2e034f414288f2f695af3f4009/users/1c156a74b41d45aab86fda3439a69f0f/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:58.952134 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:58.963574 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561d56-86f9-432b-bc94-aa3de1de1d42 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:59.044698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab7c36-358e-4cf2-89c7-3433902f7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:59.046387 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab7c36-358e-4cf2-89c7-3433902f7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:59.047801 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab7c36-358e-4cf2-89c7-3433902f7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:59.048982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab7c36-358e-4cf2-89c7-3433902f7b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:59.050562 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab7c36-358e-4cf2-89c7-3433902f7b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:59.052468 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab7c36-358e-4cf2-89c7-3433902f7b3e admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:59.078306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1377/2782] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:25:59.080299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:59.097206 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef5cf-f1d9-4802-8003-35a8ac46e0bd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:59.104808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:59.105994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:59.106664 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:59.107284 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] PATH_INFO: `/v3/projects/67170a2e034f414288f2f695af3f4009/users/1c156a74b41d45aab86fda3439a69f0f/roles/f94dc1ad1f1d4d84887223ee766cae73` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:59.111283 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67170a2e034f414288f2f695af3f4009, user_id=1c156a74b41d45aab86fda3439a69f0f, role_id=f94dc1ad1f1d4d84887223ee766cae73)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:59.114914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:59.135313 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1406/2783] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:25:59 2022] PUT /identity/v3/projects/67170a2e034f414288f2f695af3f4009/users/1c156a74b41d45aab86fda3439a69f0f/roles/f94dc1ad1f1d4d84887223ee766cae73 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:25:59.153204 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:59.153500 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:59.153786 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:59.192115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] MFA Rules not processed for user `1c156a74b41d45aab86fda3439a69f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:25:59.192115 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:59.213121 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:59.266894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:59.289698 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1378/2784] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:25:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:25:59.298997 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:25:59.300724 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:25:59.374095 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d244-0fd1-47d8-be24-1331dfcffc0c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:25:59.378015 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:25:59.378641 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:25:59.378925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:25:59.379205 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:25:59.446177 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:25:59.447481 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:25:59.457554 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1407/2785] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:25:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:25:59.556826 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:25:59.584226 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:00.370168 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:00.538296 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:01.014719 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:01.016761 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:01.082687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1b345-55f4-4e50-b3ea-a85ecd7cb0dd None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:01.087364 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:01.088002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:01.088288 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:01.088565 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] PATH_INFO: `/v3/users/4a389b840d504d3b84e87642cb137f98` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:01.089834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a389b840d504d3b84e87642cb137f98)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:01.091834 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:01.303119 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a389b840d504d3b84e87642cb137f98'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:01.303982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a389b840d504d3b84e87642cb137f98'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:01.318695 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a389b840d504d3b84e87642cb137f98'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:01.457677 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a389b840d504d3b84e87642cb137f98'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:01.458434 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a389b840d504d3b84e87642cb137f98'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:01.475350 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1379/2786] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:01 2022] DELETE /identity/v3/users/4a389b840d504d3b84e87642cb137f98 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:26:01.481542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:01.572806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:01.688294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:01.690570 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:01.701698 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edddcb-7203-4502-a5b2-6232d51d71c0 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:01.750286 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:01.750792 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:01.751277 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:01.752551 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:01.754366 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:01.800679 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:01.802630 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:01.818255 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:01.819750 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:01.829084 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1408/2787] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:26:01.882414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcc025-f599-470b-9d6d-8f6909b8a3e4 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:01.887269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:01.887991 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:01.888279 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:01.888559 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] PATH_INFO: `/v3/projects/f3862c7d0d844d1f81d014f40a28ccd6` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:01.889794 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3862c7d0d844d1f81d014f40a28ccd6)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:01.893806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:02.033358 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3862c7d0d844d1f81d014f40a28ccd6', 'request_id': 'req-458978f9-963b-46aa-af5c-b67401a0ddad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.040108 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3862c7d0d844d1f81d014f40a28ccd6', 'request_id': 'req-458978f9-963b-46aa-af5c-b67401a0ddad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.045977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3862c7d0d844d1f81d014f40a28ccd6', 'request_id': 'req-458978f9-963b-46aa-af5c-b67401a0ddad'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.140632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] The token cache is being invalidate because project f3862c7d0d844d1f81d014f40a28ccd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:02.140920 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.141549 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.143718 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1380/2788] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:01 2022] DELETE /identity/v3/projects/f3862c7d0d844d1f81d014f40a28ccd6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:26:02.147892 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:02.159560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fadaa-7cb8-4b15-b4a9-4157f882f83c service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:02.215431 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:02.216069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:02.216354 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:02.216657 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] PATH_INFO: `/v3/users/1ce9d107680c4266907701e21a8c2d42` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:02.217828 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce9d107680c4266907701e21a8c2d42)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:02.219761 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:02.236727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:02.575822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce9d107680c4266907701e21a8c2d42'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.582760 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce9d107680c4266907701e21a8c2d42'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.590393 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce9d107680c4266907701e21a8c2d42'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.598600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce9d107680c4266907701e21a8c2d42'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.691860 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce9d107680c4266907701e21a8c2d42'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:02.698810 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1409/2789] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:02 2022] DELETE /identity/v3/users/1ce9d107680c4266907701e21a8c2d42 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:02.741967 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:02.967193 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:02.968656 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:02.983605 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458978f9-963b-46aa-af5c-b67401a0ddad admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:03.045592 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:03.046329 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:03.046533 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:03.046806 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] PATH_INFO: `/v3/projects/9d6d84378813465d9bbc87eac754ecb1` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:03.047946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6d84378813465d9bbc87eac754ecb1)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:03.050431 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:03.197059 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6d84378813465d9bbc87eac754ecb1', 'request_id': 'req-2a896311-51c8-4198-a1e2-23c3dbb1de4d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:03.203276 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6d84378813465d9bbc87eac754ecb1', 'request_id': 'req-2a896311-51c8-4198-a1e2-23c3dbb1de4d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:03.209084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6d84378813465d9bbc87eac754ecb1', 'request_id': 'req-2a896311-51c8-4198-a1e2-23c3dbb1de4d'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:03.244749 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:03.375410 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] The token cache is being invalidate because project 9d6d84378813465d9bbc87eac754ecb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:03.375703 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:03.376946 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:03.378526 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1381/2790] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:02 2022] DELETE /identity/v3/projects/9d6d84378813465d9bbc87eac754ecb1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:03.826968 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:03.844688 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:03.846280 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:03.906028 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e76aa-2e2e-4ca8-8df4-5feab6455463 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:03.938456 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:03.941190 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:03.958736 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86231e99-ef65-470b-92c0-0142cd5c525a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:03.959441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86231e99-ef65-470b-92c0-0142cd5c525a service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:03.960136 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86231e99-ef65-470b-92c0-0142cd5c525a service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:03.960478 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86231e99-ef65-470b-92c0-0142cd5c525a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:03.962587 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-86231e99-ef65-470b-92c0-0142cd5c525a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:03.976445 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:04.009195 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896311-51c8-4198-a1e2-23c3dbb1de4d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:04.015542 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:04.016262 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:04.019627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:04.019627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] PATH_INFO: `/v3/users/f27e2bf4670c4447a26a0c4005790038` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:04.019627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27e2bf4670c4447a26a0c4005790038)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:04.020611 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:04.034502 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86231e99-ef65-470b-92c0-0142cd5c525a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:04.035958 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86231e99-ef65-470b-92c0-0142cd5c525a service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:04.046080 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1410/2791] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:26:04.148992 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:04.278855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27e2bf4670c4447a26a0c4005790038'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:04.279531 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27e2bf4670c4447a26a0c4005790038'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:04.294929 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27e2bf4670c4447a26a0c4005790038'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:04.375928 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:04.434516 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27e2bf4670c4447a26a0c4005790038'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:04.435145 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27e2bf4670c4447a26a0c4005790038'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:04.446862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:04.451306 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1382/2792] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:03 2022] DELETE /identity/v3/users/f27e2bf4670c4447a26a0c4005790038 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:04.456060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:04.459207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:04.459207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:04.475989 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:04.477195 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:04.536647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1411/2793] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:04.546687 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:04.548861 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:04.606038 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f8911-6118-4e4b-ae3e-374566b7bb7d admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:04.609838 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a49b9b-342f-4ade-aff0-d0026cf22763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:04.611107 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49b9b-342f-4ade-aff0-d0026cf22763 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:04.611606 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49b9b-342f-4ade-aff0-d0026cf22763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:04.611890 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49b9b-342f-4ade-aff0-d0026cf22763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:04.622224 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a49b9b-342f-4ade-aff0-d0026cf22763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:04.623667 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a49b9b-342f-4ade-aff0-d0026cf22763 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:04.635738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1383/2794] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:26:04.709352 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:04.910272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:05.074058 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:05.075467 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:05.090870 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049ca9a-14e3-4e62-b810-1ac1955f8a23 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:05.096191 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:05.097022 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.097301 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.097575 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] PATH_INFO: `/v3/projects/09cb55995b6f496fa3a7f0dda32a9a17` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.099507 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cb55995b6f496fa3a7f0dda32a9a17)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:05.101808 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:05.245418 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:05.266491 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cb55995b6f496fa3a7f0dda32a9a17', 'request_id': 'req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:05.273147 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cb55995b6f496fa3a7f0dda32a9a17', 'request_id': 'req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:05.360072 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cb55995b6f496fa3a7f0dda32a9a17', 'request_id': 'req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:05.367995 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] The token cache is being invalidate because project 09cb55995b6f496fa3a7f0dda32a9a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:05.368289 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:05.368929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-155481ba-fd06-47c4-bf76-0f4c5e52cbe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:05.370455 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1412/2795] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:05 2022] DELETE /identity/v3/projects/09cb55995b6f496fa3a7f0dda32a9a17 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:05.376748 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb069-74ec-4b0b-b671-bb1d2dd14b01 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.377924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb069-74ec-4b0b-b671-bb1d2dd14b01 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.377924 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb069-74ec-4b0b-b671-bb1d2dd14b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.398616 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-0bbbb069-74ec-4b0b-b671-bb1d2dd14b01 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:05.399886 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-0bbbb069-74ec-4b0b-b671-bb1d2dd14b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:05.463489 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1384/2796] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:05.471383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aafdc-b7d4-40f1-ace8-c994c1055f36 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.471686 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aafdc-b7d4-40f1-ace8-c994c1055f36 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.473867 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aafdc-b7d4-40f1-ace8-c994c1055f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.492232 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:05.494692 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c61aafdc-b7d4-40f1-ace8-c994c1055f36 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:05.495914 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c61aafdc-b7d4-40f1-ace8-c994c1055f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:05.505816 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1413/2797] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:05.509961 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbb069-74ec-4b0b-b671-bb1d2dd14b01 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:05.520031 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbb069-74ec-4b0b-b671-bb1d2dd14b01 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:05.524608 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:05.525215 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.525494 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.525799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.526488 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:26:05.526789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:05.528367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:05.540404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1385/2798] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:26:05.544951 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61aafdc-b7d4-40f1-ace8-c994c1055f36 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:05.555021 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61aafdc-b7d4-40f1-ace8-c994c1055f36 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:05.559665 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:05.560291 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.569858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.569858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.569858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:05.569858 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:05.617992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:05.682621 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1414/2799] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:26:05 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:26:05.686918 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:05.698532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af4620-d9f6-4d73-8c9f-de30558e0643 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:05.757293 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:05.757950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.758230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.758505 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.759160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:05.761078 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:05.913822 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1386/2800] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:26:05 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:26:05.917891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:05.929118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2cc06-8f07-4fab-86eb-02a6885bfbeb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:05.933967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:05.934573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.934854 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.935130 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.935857 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:05.937696 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:05.957967 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1415/2801] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:26:05.967604 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:05.987708 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45118047-3b3b-4a62-906f-c826ccd4cbf0 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:05.992652 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f48e1-762e-4247-97bf-b6c69984a999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:05.993594 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f48e1-762e-4247-97bf-b6c69984a999 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:05.993950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f48e1-762e-4247-97bf-b6c69984a999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:05.994230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f48e1-762e-4247-97bf-b6c69984a999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:05.994934 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f48e1-762e-4247-97bf-b6c69984a999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:05.996644 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f48e1-762e-4247-97bf-b6c69984a999 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:06.012091 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1387/2802] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:26:06.013240 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:06.024113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553afa1-4191-4f80-b94b-679b7e9d0af8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:06.034407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:06.034407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:06.034407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:06.034407 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] PATH_INFO: `/v3/projects/1ce6ec86841649a4ba2dd1f62a4d9037/users/a69e469fc29e4399976745b5b5d3369e/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:06.047617 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce6ec86841649a4ba2dd1f62a4d9037, user_id=a69e469fc29e4399976745b5b5d3369e, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:06.051413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:06.172069 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1416/2803] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:26:06 2022] PUT /identity/v3/projects/1ce6ec86841649a4ba2dd1f62a4d9037/users/a69e469fc29e4399976745b5b5d3369e/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:06.184876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79acff-6c58-455c-9d16-c6c32e58a2d9 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:06.184876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79acff-6c58-455c-9d16-c6c32e58a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:06.184876 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79acff-6c58-455c-9d16-c6c32e58a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:06.200669 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9c79acff-6c58-455c-9d16-c6c32e58a2d9 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:06.201910 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9c79acff-6c58-455c-9d16-c6c32e58a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:06.262738 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1388/2804] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:06.273310 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:06.275060 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:06.333229 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f47dc0-870f-44de-b765-71b03bff62a1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:06.336925 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:06.337655 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:06.337969 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:06.338241 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:06.348647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:06.353103 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:06.360094 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1417/2805] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:26:06.554948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:06.606369 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:07.896955 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:07.898950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:07.898950 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:07.934442 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] MFA Rules not processed for user `a69e469fc29e4399976745b5b5d3369e`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:07.935552 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:08.013298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1389/2806] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:08.025113 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:08.026528 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:08.087308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5e507-3ba8-4c0a-990c-edac00c76e89 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:08.091936 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ac5a3-0054-4c39-8377-a918a58dcffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:08.092560 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac5a3-0054-4c39-8377-a918a58dcffb service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:08.092847 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac5a3-0054-4c39-8377-a918a58dcffb service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:08.093128 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac5a3-0054-4c39-8377-a918a58dcffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:08.102355 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ac5a3-0054-4c39-8377-a918a58dcffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:08.103819 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ac5a3-0054-4c39-8377-a918a58dcffb service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:08.114464 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1418/2807] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:26:08.942894 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:08.944362 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:08.963125 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9fa49-7658-4955-953e-b3e6eb78648d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:08.967956 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:08.970048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:08.970048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:08.970048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] PATH_INFO: `/v3/users/0c5e991ab0b54e5e8b82e2357c91b5d8` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:08.970603 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5e991ab0b54e5e8b82e2357c91b5d8)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:08.972764 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:09.260253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:09.265632 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5e991ab0b54e5e8b82e2357c91b5d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:09.266327 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5e991ab0b54e5e8b82e2357c91b5d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:09.279639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5e991ab0b54e5e8b82e2357c91b5d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:09.398799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5e991ab0b54e5e8b82e2357c91b5d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:09.399438 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5e991ab0b54e5e8b82e2357c91b5d8'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:09.413982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1390/2808] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:08 2022] DELETE /identity/v3/users/0c5e991ab0b54e5e8b82e2357c91b5d8 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:26:09.418722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652577-65c4-4c98-a85d-75b5ed6bea6c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:09.419207 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652577-65c4-4c98-a85d-75b5ed6bea6c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:09.419306 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652577-65c4-4c98-a85d-75b5ed6bea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:09.440891 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a6652577-65c4-4c98-a85d-75b5ed6bea6c None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:09.442142 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a6652577-65c4-4c98-a85d-75b5ed6bea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:09.503383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1419/2809] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:09.513249 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:09.514680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:09.575213 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb6c4c-59c6-4697-9803-a2ac2c0c1cc8 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:09.579223 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:09.579969 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:09.580812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:09.581104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:09.590853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:09.592280 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:09.602222 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1391/2810] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:26:09.976610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:09.976944 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:09.977179 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:09.997319 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] MFA Rules not processed for user `a69e469fc29e4399976745b5b5d3369e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:09.998591 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:10.060326 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1420/2811] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:10.063958 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:10.066278 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:10.079624 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8bb72-3251-4edb-a1c3-771a5cb9f243 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:10.086711 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:10.087432 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:10.087789 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:10.088138 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] PATH_INFO: `/v3/users/1f8bdb76b8574a6fbcb4d05e3b21a522` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:10.089450 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8bdb76b8574a6fbcb4d05e3b21a522)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:10.091688 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:10.225743 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:10.227338 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:10.241628 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f2aa-918c-48bd-a1eb-f691ef86f64d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:10.246555 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:10.247667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:10.248012 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:10.248413 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] PATH_INFO: `/v3/projects/9c4798fa212e408c8eeaeb0a4317d53f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:10.249796 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4798fa212e408c8eeaeb0a4317d53f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:10.252579 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:10.264955 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:10.304904 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8bdb76b8574a6fbcb4d05e3b21a522'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.305586 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8bdb76b8574a6fbcb4d05e3b21a522'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.319244 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8bdb76b8574a6fbcb4d05e3b21a522'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.390294 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4798fa212e408c8eeaeb0a4317d53f', 'request_id': 'req-554a03e5-53a5-4a91-9c2c-c3f089212e5b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.396668 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4798fa212e408c8eeaeb0a4317d53f', 'request_id': 'req-554a03e5-53a5-4a91-9c2c-c3f089212e5b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.428553 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8bdb76b8574a6fbcb4d05e3b21a522'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.429183 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-29774de3-e192-4065-b07e-0bb08b73a3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8bdb76b8574a6fbcb4d05e3b21a522'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.442985 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1392/2812] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:10 2022] DELETE /identity/v3/users/1f8bdb76b8574a6fbcb4d05e3b21a522 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:26:10.444952 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4ff5-d08b-454f-a304-6c405ed18839 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:10.445269 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4ff5-d08b-454f-a304-6c405ed18839 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:10.445601 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4ff5-d08b-454f-a304-6c405ed18839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-9b0a4ff5-d08b-454f-a304-6c405ed18839 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:26:10.452277 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:26:10.454216 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:26:10.455344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1393/2813] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:26:10 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:26:10.455344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:10.455344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:10.455344 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:10.481784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:10.481784 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:10.513086 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:10.521066 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4798fa212e408c8eeaeb0a4317d53f', 'request_id': 'req-554a03e5-53a5-4a91-9c2c-c3f089212e5b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.535994 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] The token cache is being invalidate because project 9c4798fa212e408c8eeaeb0a4317d53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:10.536432 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.537197 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.539118 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1421/2814] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:10 2022] DELETE /identity/v3/projects/9c4798fa212e408c8eeaeb0a4317d53f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:26:10.543486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:10.544864 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:10.551089 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1394/2815] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:10.567025 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:10.568404 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:10.612317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a03e5-53a5-4a91-9c2c-c3f089212e5b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:10.617325 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:10.618093 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:10.618383 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:10.618667 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] PATH_INFO: `/v3/users/cdb42b7f7e09405da73a0e6e5e7b4d72` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:10.620070 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb42b7f7e09405da73a0e6e5e7b4d72)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:10.622388 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:10.627287 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d480e-92d6-43e3-8056-3be11ec34e92 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:10.631647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:10.632260 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:10.632576 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:10.632853 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:10.645799 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:10.647490 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:10.658812 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1395/2816] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 09:26:10.842317 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb42b7f7e09405da73a0e6e5e7b4d72'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.842970 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb42b7f7e09405da73a0e6e5e7b4d72'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.861238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb42b7f7e09405da73a0e6e5e7b4d72'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.873471 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb42b7f7e09405da73a0e6e5e7b4d72'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:10.989685 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e7da25ea-32b8-40e6-9eaf-ecab658f5864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb42b7f7e09405da73a0e6e5e7b4d72'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.017441 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1422/2817] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:10 2022] DELETE /identity/v3/users/cdb42b7f7e09405da73a0e6e5e7b4d72 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:11.154353 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.155813 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:11.171363 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d344-a44f-4776-ab74-21dbaae82174 service neutron] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.236051 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.236693 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.236977 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.237915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] PATH_INFO: `/v3/projects/9a94852dc9c741c884ba48057f24c04d` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.239196 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a94852dc9c741c884ba48057f24c04d)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.241082 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:11.383665 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a94852dc9c741c884ba48057f24c04d', 'request_id': 'req-fc424323-4e84-4f50-aa0e-960bcfc66d8f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.392448 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a94852dc9c741c884ba48057f24c04d', 'request_id': 'req-fc424323-4e84-4f50-aa0e-960bcfc66d8f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.400367 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a94852dc9c741c884ba48057f24c04d', 'request_id': 'req-fc424323-4e84-4f50-aa0e-960bcfc66d8f'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.489048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] The token cache is being invalidate because project 9a94852dc9c741c884ba48057f24c04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:11.489514 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.490272 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-fc424323-4e84-4f50-aa0e-960bcfc66d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.496102 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1396/2818] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:11 2022] DELETE /identity/v3/projects/9a94852dc9c741c884ba48057f24c04d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:11.498297 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.498593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.498877 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.520759 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:11.523365 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:11.535444 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:11.583482 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1423/2819] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:11.591647 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99615a-bbc9-4d24-a67a-067a90f05e7b None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.591875 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99615a-bbc9-4d24-a67a-067a90f05e7b None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.592159 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99615a-bbc9-4d24-a67a-067a90f05e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.607197 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:11.612954 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-9d99615a-bbc9-4d24-a67a-067a90f05e7b None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:11.614312 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-9d99615a-bbc9-4d24-a67a-067a90f05e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:11.621820 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.623476 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:11.627020 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1397/2820] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:11.628126 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99615a-bbc9-4d24-a67a-067a90f05e7b None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.638035 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad97e4-ebed-4f37-bcc4-c36598af82c5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.638253 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99615a-bbc9-4d24-a67a-067a90f05e7b None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.644416 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.644567 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.645044 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.645342 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.645532 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.645647 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.645849 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.645953 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] PATH_INFO: `/v3/projects/b3e180cd15404806be59dd9a1e83ecc4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.646502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:26:11.646807 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.647308 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e180cd15404806be59dd9a1e83ecc4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.648449 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:11.649513 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:11.661541 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1398/2821] 10.222.0.71 () {58 vars in 1153 bytes} [Tue Aug 2 09:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:26:11.665862 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.675701 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396413b-55cb-4af2-9eaf-927c968c8d36 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.680626 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.681236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.681523 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.681859 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.682569 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.684568 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:11.783237 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e180cd15404806be59dd9a1e83ecc4', 'request_id': 'req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.789929 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e180cd15404806be59dd9a1e83ecc4', 'request_id': 'req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.796081 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1399/2822] 10.222.0.71 () {60 vars in 1153 bytes} [Tue Aug 2 09:26:11 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:26:11.800409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.847275 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e180cd15404806be59dd9a1e83ecc4', 'request_id': 'req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.858992 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] The token cache is being invalidate because project b3e180cd15404806be59dd9a1e83ecc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:11.859311 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.859991 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:11.864756 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1424/2823] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:11 2022] DELETE /identity/v3/projects/b3e180cd15404806be59dd9a1e83ecc4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:11.868602 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a908-a6ce-4b1e-bb2b-a2f202fbf113 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.868722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.868722 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:11.869227 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.869944 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.870228 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.870502 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] PATH_INFO: `/v3/users` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.871160 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.873397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:11.932847 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1400/2824] 10.222.0.71 () {60 vars in 1144 bytes} [Tue Aug 2 09:26:11 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:26:11.933925 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.935986 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6166cf-a8bc-4c0d-abfa-80ba21a18c10 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.937083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:11.941850 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.942489 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.942767 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.943039 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] PATH_INFO: `/v3/users/1c156a74b41d45aab86fda3439a69f0f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.944264 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c156a74b41d45aab86fda3439a69f0f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.946213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:11.950026 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd43d09-1331-4a3f-a42f-37eb86793f26 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.954729 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.955338 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.955623 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.956525 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.957417 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.959155 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:11.972948 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1401/2825] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:26:11.974101 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:11.983657 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5980f5-fbd8-4ad3-a000-bdadc514f252 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:11.989002 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:11.989625 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] REQUEST_METHOD: `GET` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:11.989947 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:11.990256 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:11.990993 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:11.992610 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:12.004157 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1402/2826] 10.222.0.71 () {58 vars in 1122 bytes} [Tue Aug 2 09:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:26:12.008537 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:12.018007 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f5bb-834c-4968-af7f-8036af16d046 admin admin] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:12.023547 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb2eaa-db2e-49bb-82f0-a5175e124b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:12.024172 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb2eaa-db2e-49bb-82f0-a5175e124b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:12.024457 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb2eaa-db2e-49bb-82f0-a5175e124b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:12.024735 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb2eaa-db2e-49bb-82f0-a5175e124b96 admin admin] PATH_INFO: `/v3/projects/36fc86fda73a48aa8857bed57eb7b476/users/5957db14a885434c8451247ff3227fc4/roles/15cbc1d04d5a479d9bf50df00a5e2506` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:12.040298 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb2eaa-db2e-49bb-82f0-a5175e124b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fc86fda73a48aa8857bed57eb7b476, user_id=5957db14a885434c8451247ff3227fc4, role_id=15cbc1d04d5a479d9bf50df00a5e2506)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:12.044294 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb2eaa-db2e-49bb-82f0-a5175e124b96 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:12.146573 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c156a74b41d45aab86fda3439a69f0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.147373 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c156a74b41d45aab86fda3439a69f0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.159959 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c156a74b41d45aab86fda3439a69f0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.166975 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c156a74b41d45aab86fda3439a69f0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.173551 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1403/2827] 10.222.0.71 () {60 vars in 1483 bytes} [Tue Aug 2 09:26:12 2022] PUT /identity/v3/projects/36fc86fda73a48aa8857bed57eb7b476/users/5957db14a885434c8451247ff3227fc4/roles/15cbc1d04d5a479d9bf50df00a5e2506 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:26:12.178322 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:12.178614 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:12.178895 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:12.207178 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] MFA Rules not processed for user `5957db14a885434c8451247ff3227fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:12.208440 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:12.245332 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:12.246235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c156a74b41d45aab86fda3439a69f0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.257194 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1425/2828] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:11 2022] DELETE /identity/v3/users/1c156a74b41d45aab86fda3439a69f0f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:12.281680 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1404/2829] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 09:26:12.301251 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:12.304244 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:12.347811 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:12.364610 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2a2a0-34c7-4a6d-8fbf-dfebcf370fe3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:12.368361 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06a2008ab3a2497eba5e8394277c2316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:12.368979 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:12.369262 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:12.369542 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:12.437381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:12.437381 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:12.439865 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1426/2830] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:26:12.465510 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:12.467004 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:12.532397 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eb8af-9461-4966-859f-9c9b7d5b8b3d None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:12.589498 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:12.590176 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:12.590460 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:12.590736 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] PATH_INFO: `/v3/users/5957db14a885434c8451247ff3227fc4` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:12.591915 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5957db14a885434c8451247ff3227fc4)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:12.593883 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:12.836550 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:12.838082 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:12.853020 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be75e-c9ee-4cb8-85fc-2f565de3d965 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:12.858227 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:12.861659 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:12.866148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:12.866148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] PATH_INFO: `/v3/projects/67170a2e034f414288f2f695af3f4009` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:12.866148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67170a2e034f414288f2f695af3f4009)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:12.866148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:12.875409 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5957db14a885434c8451247ff3227fc4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.876390 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5957db14a885434c8451247ff3227fc4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.889141 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5957db14a885434c8451247ff3227fc4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.960035 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5957db14a885434c8451247ff3227fc4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.960671 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-2465eff0-0b29-4d42-bf90-2dd0705dd335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5957db14a885434c8451247ff3227fc4'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.974967 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1405/2831] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:12 2022] DELETE /identity/v3/users/5957db14a885434c8451247ff3227fc4 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:12.978522 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67170a2e034f414288f2f695af3f4009', 'request_id': 'req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:12.979540 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:12.979827 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:12.980230 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:12.984360 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67170a2e034f414288f2f695af3f4009', 'request_id': 'req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.001083 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.auth.core [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] MFA Rules not processed for user `277adb39cd4b4eaeb8a14cfd02357b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:13.002336 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:13.021960 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:13.039991 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67170a2e034f414288f2f695af3f4009', 'request_id': 'req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.047752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:13.052337 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] The token cache is being invalidate because project 67170a2e034f414288f2f695af3f4009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:13.052624 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.053261 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.054881 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1427/2832] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:12 2022] DELETE /identity/v3/projects/67170a2e034f414288f2f695af3f4009 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:13.063982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1406/2833] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:13.074224 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:13.075752 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:13.141588 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3a49a-5cef-431d-bd8a-53ca9a1d2458 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:13.197164 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b0cc7-0bb4-41e8-a25d-79953ffaec9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f8fdc63709648dfbefb06f1b2db7ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:13.197842 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0cc7-0bb4-41e8-a25d-79953ffaec9d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:13.198148 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0cc7-0bb4-41e8-a25d-79953ffaec9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:13.198422 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0cc7-0bb4-41e8-a25d-79953ffaec9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:13.210085 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b0cc7-0bb4-41e8-a25d-79953ffaec9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:13.211817 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b0cc7-0bb4-41e8-a25d-79953ffaec9d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:13.223687 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1428/2834] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:26:13.692084 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:13.693659 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:13.707982 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60febb91-0d9d-4d90-ac51-c26542d4e542 None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:13.713307 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:13.714179 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:13.715236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:13.715236 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] PATH_INFO: `/v3/projects/36fc86fda73a48aa8857bed57eb7b476` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:13.716252 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=36fc86fda73a48aa8857bed57eb7b476)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:13.718597 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:13.870848 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36fc86fda73a48aa8857bed57eb7b476', 'request_id': 'req-f51ea917-dc39-414f-9049-d431f3002dbc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.883964 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36fc86fda73a48aa8857bed57eb7b476', 'request_id': 'req-f51ea917-dc39-414f-9049-d431f3002dbc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.889814 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36fc86fda73a48aa8857bed57eb7b476', 'request_id': 'req-f51ea917-dc39-414f-9049-d431f3002dbc'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.963635 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] The token cache is being invalidate because project 36fc86fda73a48aa8857bed57eb7b476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:13.963855 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.964536 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-f51ea917-dc39-414f-9049-d431f3002dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:13.966188 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1407/2835] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:13 2022] DELETE /identity/v3/projects/36fc86fda73a48aa8857bed57eb7b476 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:14.915238 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:14.915727 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:14.915824 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:14.934600 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] MFA Rules not processed for user `a69e469fc29e4399976745b5b5d3369e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:26:14.935822 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:14.989599 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1429/2836] 10.222.0.71 () {58 vars in 958 bytes} [Tue Aug 2 09:26:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 09:26:15.221919 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f14ea-6628-4436-b228-ff88168d475f None None] REQUEST_METHOD: `POST` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:15.222462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f14ea-6628-4436-b228-ff88168d475f None None] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:15.222462 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f14ea-6628-4436-b228-ff88168d475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application [None req-a10f14ea-6628-4436-b228-ff88168d475f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:26:15.229041 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 02 09:26:15.230104 dv-cinder-803823-15-smb devstack@keystone.service[80521]: ERROR keystone.server.flask.application Aug 02 09:26:15.231225 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1408/2837] 10.222.0.71 () {58 vars in 1009 bytes} [Tue Aug 2 09:26:15 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 02 09:26:23.960414 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:24.983129 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=72 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:35.476169 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:35.478037 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:35.554493 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fb832-4c3a-4bc7-a5c0-e6c0ab0328a2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:35.558976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:35.559606 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:35.559884 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:35.560155 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] PATH_INFO: `/v3/users/a69e469fc29e4399976745b5b5d3369e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:35.561299 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69e469fc29e4399976745b5b5d3369e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:35.563235 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:35.780057 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69e469fc29e4399976745b5b5d3369e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:35.780716 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69e469fc29e4399976745b5b5d3369e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:35.793096 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69e469fc29e4399976745b5b5d3369e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:35.799893 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69e469fc29e4399976745b5b5d3369e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:35.878346 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69e469fc29e4399976745b5b5d3369e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:35.885401 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1430/2838] 10.222.0.71 () {58 vars in 1224 bytes} [Tue Aug 2 09:26:35 2022] DELETE /identity/v3/users/a69e469fc29e4399976745b5b5d3369e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:26:36.098881 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f14ea-6628-4436-b228-ff88168d475f None None] Authenticating user token {{(pid=80521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:36.100691 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.fernet_utils [None req-a10f14ea-6628-4436-b228-ff88168d475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:36.169092 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f14ea-6628-4436-b228-ff88168d475f None None] Validating token access rules against request {{(pid=80521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:36.173658 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '277adb39cd4b4eaeb8a14cfd02357b07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '111a65792e6b4d558825e4b022d50a1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:36.175994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:36.175994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] SCRIPT_NAME: `/identity` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:36.175994 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] PATH_INFO: `/v3/projects/1ce6ec86841649a4ba2dd1f62a4d9037` {{(pid=80521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:36.176595 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce6ec86841649a4ba2dd1f62a4d9037)` {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:36.178527 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] RBAC: Authorization granted {{(pid=80521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:36.291627 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce6ec86841649a4ba2dd1f62a4d9037', 'request_id': 'req-e8748362-aaad-47d5-88d7-7f650c10275c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:36.293097 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce6ec86841649a4ba2dd1f62a4d9037', 'request_id': 'req-e8748362-aaad-47d5-88d7-7f650c10275c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:36.299075 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce6ec86841649a4ba2dd1f62a4d9037', 'request_id': 'req-e8748362-aaad-47d5-88d7-7f650c10275c'} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:36.386048 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] The token cache is being invalidate because project 1ce6ec86841649a4ba2dd1f62a4d9037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 09:26:36.386281 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:36.386921 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG keystone.notifications [None req-e8748362-aaad-47d5-88d7-7f650c10275c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 09:26:36.388443 dv-cinder-803823-15-smb devstack@keystone.service[80521]: [pid: 80521|app: 0|req: 1409/2839] 10.222.0.71 () {58 vars in 1233 bytes} [Tue Aug 2 09:26:36 2022] DELETE /identity/v3/projects/1ce6ec86841649a4ba2dd1f62a4d9037 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:26:45.881597 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:46.382639 dv-cinder-803823-15-smb devstack@keystone.service[80521]: DEBUG dbcounter [-] [80521] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:50.777414 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:26:50.778883 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:50.849486 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ac76-7101-43b6-b749-20468ee7c99c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:26:50.909976 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c46b03-c006-4d59-9913-1e2c604a2865 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41aaa2d337974ae29ef28b1126e70435', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7e4f4acb124c5ba3528dcf05233ee2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:26:50.910593 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46b03-c006-4d59-9913-1e2c604a2865 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:26:50.910972 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46b03-c006-4d59-9913-1e2c604a2865 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:26:50.911215 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46b03-c006-4d59-9913-1e2c604a2865 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:26:50.913013 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-69c46b03-c006-4d59-9913-1e2c604a2865 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:26:50.924213 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c46b03-c006-4d59-9913-1e2c604a2865 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:26:50.926004 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c46b03-c006-4d59-9913-1e2c604a2865 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:26:50.935905 dv-cinder-803823-15-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1431/2840] 10.222.0.71 () {60 vars in 1365 bytes} [Tue Aug 2 09:26:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 09:27:00.931608 dv-cinder-803823-15-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=58 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}